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Method for modelling customised earpieces 

This application is a non-provisional of U.S. provisional application Serial No. 
60/275,112 filed 13 March 2001, which is hereby incorporated by reference in its 
5 entirety. It claims priority from Danish patent applications no PA 2001 00346 filed on 
2 March 2001, PA 2001 00519 filed on 28 March 2001 and PA 2001 01521 filed on 
1 7 October 2001 , which are hereby incorporated by reference in their entirety. 

All patent and non-patent references cited in the application, or in the present 
1 0 application, are also hereby incorporated by reference in their entirety. 

Technical field of the invention 

The present invention relates to a method for computer-controlled modelling of 
customised earpieces. These earpieces include housings for hearing aids, wireless 

15 or connected communication devices (headsets, mobile phones, personal agents), 
loud speakers, tinnitus masking devices, devices recording vibrations in the skull 
and transforming these into audio signals, voice recognition devices, earplugs, noise 
blockers with selective frequencies or sound levels, Man Machine Interface (MMI) 
products that enable clear communication even in the noisiest environments, or 

20 products related to wireless Internet applications. All these earpieces may be worn 
in the user's meatus and/or auditory canal. The invention also relates to a 
computerised system for manufacturing such customised earpieces. In particular, 
the invention is directed to a computerised system that models an earpiece based 
on a three-dimensional replica of the user's meatus and/or auditory canal. The 

25 system also provides for a number of operations and modifications to be performed 
on the reproduction. 

Background of the invention 

Many existing applications, such as in-the-ear (ITE), in-the-channel (ITC), or 
30 . completely-in-the-channel (CIC) housings for hearing aids and personal 
communication devices (mobile phones or headsets) require the reproduction of 
one-of-a-kind parts of complex geometry. In these applications, the parts are unique 
and require a highly precise fit of the replacement part. Sub-millimetre precision is 
for example required for ITE, ITC or CIC hearing aid housings; the housing will 
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lithography, selective laser sintering, laminate object modelling, inkjet modelling, 
fused depositing modelling, 3DP or any other system that produces real models 
from computer mathematical models to manufacture the hearing aid shell. 

5 EP 0 516 808 (T0PHOLM & WESTERMANN APS) concerns a method for 
computer-assisted manufacture of otoplasties individually fitted to the contours of 
the ear canal. According to the described method a digital representation of the 
internal contours of the ear canal is used for the production of a hearing aid shell, 
and the digital representation is used to obtain a computer model, which can be 

10 used for manual location of the components of the hearing aid and for defining the 
thickness of the shell's walls. 

US 5,056,204 (ASCOM AUDIOSYS AG) concerns a method for the milling of 
hearing aids whereby the internal contours of the ear canal are recorded by a laser 
15 apparatus located outside the ear of the user. 

JP09103000A2 (RION CO LTD) describes a method for the production of shell for 
ear-inserted hearing aids whereby a three-dimensional shape measuring instrument 
is used to measure the shape information of the external auditory meatus directly or 

20 using a an ear model sampled by using a sealing member. Next, the shape 
information and information on the shape of the components to be integrated into a 
shell for hearing aid are inputted to a computer, and an external shape or an internal 
shape of the hearing aid shell is decided. Afterwards, the three-dimensional shape 
data of the external or internal shape decided by the computer system are inputted 

25 to an optical moulding device and the hearing aid shell is directly produced by an 
optical moulding method. 

WO 01/05207 (PHONAK AG) discloses a method for production of otoplasties, 
whereby an impression of the shape of the individual auditory canal is taken in order 

30 to produce shells for hearing aids implanted in the ear that very precisely adapt to 
the individual shape of the auditory canal and a hearing aid shell is produced by 
means of an additive fabrication process such as laser sintering, stereolithography 
or a thermojet process that is controlled by means of data pertaining to the shape. 
The disclosure provides no information on how to model the otoplasties including the 

35 placement of components.. 
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Just placing components (as mentioned in EP 0 516 808, T0PHOLM & 
WESTERMANN APS) or just cutting away parts of the original 3D model only give 
weak indications of the full earpiece and the result is likely to be of low quality. 
Furthermore, these prior art methods do not disclose how to model complex 
earpieces with more features. 



While concepts for the computer-assisted modelling and. subsequent direct 
manufacturing of custom-fitted earpieces, especially hearing aid housings, are 
mentioned in the prior art, none of the above-cited references directly discloses 
steps or operations, which may be involved in the modelling process of such 
customised earpieces. Thus, there is a need for a method and/or providing one or 
more such steps or operations that can be used in order to optimise the modelling 
and production of customised earpieces. Such a method and/or system is provided 
15 according to the present invention. 

Summary of the invention 



Figure 5 shows an overview of how the tedious manual process can be computer- 
assisted or computer-controlled leading to faster production, lower cost and higher 
acoustic and physical quality. The process consists of three main .steps: . 3D 
scanning of the impression/ear, virtual 3D modelling of the earpiece and finally 
manufacturing. The invention primarily relates to 3D modelling of the original 3D 
model acquired by the scanner as illustrated in Figure 1 0. 



The invention enables the virtual creation of a complete earpiece by arranging 
relevant components in relation to the 3D model using collision control, cutting away 
the unwanted parts of the 3D model and forming a surface, which connects 
components and the 3D model. The creation of the full earpiece facilitates a true 
evaluation of the properties of the final earpiece, e.g. visual and acoustic properties 
30 and room for components taking into account the constraint by all surfaces. 
Additionally the' virtual creation of the full earpieces enables the physical 
manufacturing of the full earpieces eliminating a large number of costly manual post 
processing operations. 
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According to a first aspect of the present invention there is provided a method for 
computer-assisted modelling of customised earpieces comprising at least one part 
being individually matched to an auditory canal and/or a meatus, said method 
comprising the steps of: . . 

5 . 

a) obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer surface, 

b) initially arranging at least one component in relation to the 3D-model, 

10 

c) initially arranging a cutting curve or cutting surface in relation to the outer surface 
of the 3D-model, said cutting curve or surface dividing the 3D-model in an outer 
portion and an inner portion, 

15 d) initially forming a connecting surface connecting the at least one component and 
the inner portion of the 3D-model, said connecting surface thereby being part of the 
3D-model, 

e) performing an evaluation of the arrangement of the at least one component, said 
20 evaluation comprising a collision detection of the at least one component in relation 

to one or more parts of the 3D-model and/or other components, and 

f) adjusting the arrangement of the at least one component, the arrangement of the 
cutting curve or surface, and/or the formation of the connecting surface based on 

25 the result of said evaluation. 

An initial cut to divide the 3D model in an inner and outer portion is not mentioned 
anywhere in the prior art relating to computer-assisted 3D modelling of customised 
earpieces. Such an initial cut is used in the manual modelling of earpieces based on 
30 impressions. In contrast to the manual method one primary advantage of the 
method according to the invention is that the initial cut performed on the 3D-model is 
optimisable, since it can be changed during the adjustment step based on the 
evaluation step. This is not possible when modelling earpieces manually and the 
possibility of optimising the initial cut in computer-assisted modelling of customised 
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earpieces is mentioned nowhere in the prior art The fact that the initial cut can be 
optimised makes the method more flexible than the methods of the prior art. 

According to the methods of the prior art, there is no guarantee that the components 
5 actually fit into the earpiece. In contrast to this the present- invention physically 
places the components in the earpiece (in a modelling operation) to make sure that 
there is space for the components. According to the present invention, if there is too 
little room for the components, further rounds of optimisation can be performed, the 
optimisation process can be repeated, material can be removed from the shell or the 
1 0 initial cutting curve/surface can be moved to create more space. 

The initial cut, dividing the 3D-model in an inner and outer portion also makes it 
possible to make a visualisation of the modelled earpiece in a virtual ear. Such 
visualisation and optimisation for appearance is not described in the prior art. The 
1 5 visual appearance of an earpiece is very important for the wearer. 

Furthermore according to the present invention, there is provided a method for 
modelling the complete 3D earpiece with all its surfaces. The methods disclosed in 
the prior art fail to provide a disclosure of how to arrange a connecting surface 
connecting the 3D model with the at least component and thereby fail to teach a 
method for modelling the complete earpiece. The fact that the complete modelling of 
a 3D-earpiece is rendered possible by the instant invention, also makes it possible 
to make an optimisation of the acoustic properties of the earpiece in the computer 
prior to prototyping and assembling it The fact that the complete earpiece can be 
modelled also makes it possible to prototype the whole piece in one operation thus 
obviating the need for assembling the piece from several pieces, such as an 
earpiece and a faceplate. However, it is still possible to incorporate a faceplate into 
the modelling according to the invention if so desired. 



20 



25 



30 



All 3D models irrespective of whether they are obtained by scanning an impression 
or by direct scanning of the auditory canal and/or meatus need to have at least the 
outer boundary of the piece modelled in order to obtain a complete earpiece. 
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Furthermore, the possibility of optimising, the placement of the at least one 
component and the connecting surface gives the possibility of optimising the visual 
appearance of the piece in the ear. 

5 In addition, an important advantage of the present invention is that the. earpiece is 
only manufactured (through rapid prototyping) once it has been established that all 
the components of the earpiece are located in the optimum Ideation. 

The order of the steps of the method according to the invention can be any. 

10 Examples of preferred orders include, but are not limited to: a) b) c) d) e) f); a) c) b) 
d) e) f); a) c) b) e) d) f); a) b) e) c) d) f); a) b) c) e) d) f). A preferred order is a) b) c) 
d) e) f), because it has turned out that by arranging the at least one component first, 
and arranging the cutting curve/surface with the aid of the at least one component 
makes it possible to model an optimal connecting surface in fewer steps and often to 

15 reach the optimal or at least an acceptable placement of the connecting surface in 
just one round. 

The adjustment process may include either the arrangement of the at least one 
component, the arrangement of the cutting curve or surface, or the formation of the 
20 connecting surface, or jt may include any combinations of the arrangement of the at 
least one component, the arrangement of the cutting curve or surface, and/pr the 
formation of the connecting surface. It is preferred that when the arrangement of the 
at least one component and/or the arrangement of the cutting curve or surface 
has/have been adjusted, the formation of the connecting surface is adjusted. 

25 

According to an embodiment of the invention, the arrangement of the at least one 
component in relation to the 3D-model may comprise arranging the at least one 
component in relation to a component surface, and arranging said component 
surface in relation to the 3D-model. Here, the connecting surface may be connecting 
30 said component surface and said inner portion of the 3D-model. It is preferred that 
the collision detection includes a collision detection, of the component surface in 
relation to one or more parts of the 3D-mpdel. 



35 



The collision detection may further include a collision detection of the mutual 
arrangement of the components themselves. 
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When arranging the components, it is preferred that the initial arrangement of the at 
least one component in relation to the 3D-modef comprises arranging at least part of 
the components substantially at the interior of the 3D-model. 
5 It should be understood that it is also within the present invention to have the 
evaluation process including an evaluation of the arrangement of the cutting curve 
or surface and/or the connecting surface. 

It is preferred that the formation of the connecting surface is computer controlled or 
10 computer assisted. It is also preferred that the formation of the connecting surface 
comprises a lofting process, where the lofting process may comprise fitting a 
parametric surface to the boundary of the inner portion of the 3D-model and to the 
boundary of a surface defining an outer boundary of the arrangement of said at least 
one component in relation to the 3D-model. Here, the outer boundary of the 
15 arrangement of said at least one component in relation to the 3D-model may be 
defined by the outer boundary of the component surface. 

It is also within an embodiment of the invention that the formation of the connecting 
surface comprises a filleting process of the edge or boundary of the inner portion of 
20 the 3D-model. Here, the outer shell surface of the 3D-model may be given in a 
vertex representation with the vertices being connected by triangles, and the filleting 
process may comprise removing at least part of the triangles in a neighbourhood 
around at least part of said edge and fitting a parametric surface to the 
neighbourhood of the hole created by the removed triangles. 

25 

According to an embodiment of the. invention, at least part of the inner portion of the 
3D-model is shelled. Here, the shelling process may be part of a modelling process 
according to the present invention, and the shelled inner portion may have an inner 
and an outer shell surface. 

30 

According to a preferred embodiment of the invention, the inner portion of the 3D- 
model at least partly comprises a representation of a model of an earpiece. 

In another embodiment of the invention the outer portion of the 3D-model at least 
35 partly comprises a model of a virtual ear. 
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It should be understood that jt is preferred that said one or more parts of the 3D- 
model in relation to which the collision detection may be performed comprise at least 
part of the inner portion and/or at least part of the outer portion of the 3D-model. 
5 Here, said one or more parts of the 3D-model in relation to which the collision 
detection may be performed may comprise at least part of the inner shell surface 
and/or at least part of an inner surface of the virtual ear. 

According to a preferred embodiment of the invention, the collision detection and the 
10 adjustment process may be repeated until the collision detection fulfils a required 
minimum criterion. 

It should be understood that the initial arrangement of the at least one component 
and/or the cutting curve or surface may be performed in several ways in accordance 

15 with the present invention. Thus, the initial arrangement may be performed manually 
or be computer-controlled or computer-assisted. The initial arrangement may be 
performed using a feature-based approach, in which features extracted from the 
obtained 3D-model are used for the arrangement, or performed using a similarity- 
based approach, in which the obtained 3D-model is compared to a number of stored 

20 3D-models of previously generated optimised models. 

When using a similarity-based approach, a stored optimised 3D-model may be 
selected as the most similar 3D-model and the initial arrangement of the at least one 
component and/or the cutting curve or surface may be selected substantially equal 
25 to the optimised arrangement of the at least one component and/or cutting curve or 
surface of said most similar 3D-model. Here, the comparison of 3D-models and 
selection of the most similar 3D-model may be computer-controlled or computer- 
assisted. 

30 It should also be understood that according to the present invention, the adjustment 
of the arrangement of the at least one component and/or the cutting curve or surface 
may be performed manually or be computer-controlled or computer-assisted. A 
computer-controlled or computer-assisted adjustment process may also or 
alternatively include the adjustment of the formation of the connecting surface. The 

35 adjustment process of the arrangement of the at least one component, and/or the 
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arrangement of the cutting curve or surface, and/or the formation of the connecting 
surface may be adjusted until no collision is detected. 

According to the present invention, the collision detection may be performed in 
several ways. Thus, the collision detection may be performed by manual . inspection 
of the three-dimensional computer model or the collision detection may be 
computer-controlled or computer-assisted. 

In a preferred embodiment of the present invention a rule-based approach may be 
used for the arrangement of the at least one component and/or the arrangement of 
the cutting curve or surface. Here, an object function, f(v), may be used. The object 
function may be defined for expressing the quality of the arrangement of the at least 
one component, and/or the arrangement of the cutting curve or surface, and/or the 
formation of the connecting surface. The object function may be an increasing 
15 function of the number of detected collisions and may be calculated for each new 
arrangement of the at least one component and/or the cutting curve or surface. It is 
preferred that the arrangement of the at least one component and/or the 
arrangement of the cutting curve or surface, and/or the formation of the connecting 
surface may be adjusted until the object function fulfils a given minimum criterion. 
20 Here, the minimum criterion may be that the object function obtains a minimum 
value, or that the difference in the values of. two successively determined object 
functions is below a defined value. When using an object function, different weights 
may be assigned to different detected collisions. 

25 It is preferred that the arrangement of the component surface and/or. the 
arrangement of the connecting surface can be adjusted without changing the 
arrangement of the at least one component. It is also preferred that the arrangement 
of the at least one component can be adjusted without changing the arrangement of 
the component surface and/or the arrangement of the connecting surface. 



30 



It should be understood that the component surface can take any convenient form; 
thus the surface may be a planar surface or a non-planar surface. 



35 



Although components may be arranged in relation to the 3D-model so as not to 
extend or so as to only extend partly into the interior portion of the 3D-model, it is 
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. also within embodiments of the present invention that components may be arranged 
at the interior or inner surface of the inner portion of the 3D-model. 

For 3D-modeIs being shelled according to the present invention, the shell of the 3D- 
5 model is preferred to have a predetermined minimum thickness. Within the present 
invention the shell is also generated by a shelling process being computer-controlled 
or computer-assisted. Here, the at least partly shelled 3D-model may be obtained 
from a three-dimensional computer model, 3D-model, of at least part of the auditory 
canal, said 3D-model having an outer shell surface being parameterised by a 
10 number of vertices, which vertices are connected by triangles, said shelling process 
comprising: 

offsetting inwardly a copy of each vertex in the outer shell surface, 

15 removing the number of copied vertices being closer to the outer shell surface than 
a given minimum shell thickness, and 

creating an inner shell by triangulation of the remaining copied vertices. 

20 Within the present invention the inner shell surface or geometry of the 3D-model is 
also modified in order to improve the strength of the finished shell, said modification 
comprising adding extra material to the inner surface of the shell, while at the same 
time avoiding collision between the modified inner shell surface and the arranged at 
least one component. Here, the addition of extra material to the inner shell surface 

25 of the 3D-model may be performed using a Boolean operation, such as a Boolean 
addition, using a transfer function or using an outward offset of the vertices 
representing the surface - 

A number of different components may be arranged in relation to the 3D-model. 
30 Such components may for example be selected from a list of components 
comprising: electronic components, battery devices, outlets to interior components, 
tubes, transducers and logos. ' 

In order to obtain a final 3D-model, further steps may be included in the modelling 
35 process. Such steps may comprise: arrangement of a ventilation channel at the 
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interior or inner surface of the inner portion of the 3D-model, an optimisation of the 
visual appearance, and/or placement of a unique identifier at the inner portion of the 
3D-model. 

According to a further aspect the invention relates to a computer program product 
including a computer readable medium, said computer readable medium having a 
computer program stored thereon, said program for causing computer-assisted 
modelling of customised earpieces comprising at least one part being individually 
matched to an auditory canal, said program comprising: 

program code for causing a computer to obtain a three-dimensional computer 
model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
outer surface, 

program code for causing a computer to initially arrange at least one component in 
relation to the 3D-model, 

program code for causing a computer to initially arrange a cutting curve or cutting 
surface in relation to the outer surface of the 3D-model, said cutting curve or surface 
dividing the 3D-model in an outer portion and an inner portion, 

program code for causing a computer to initially form a connecting surface 
connecting the at least one component and the inner portion of the 3D-model, said 
connecting surface thereby being part of the 3D-model, 

program code for causing a computer to perform an evaluation of the arrangement 
of the at least one component, said evaluation comprising a collision detection of the 
at least one component in relation to one or more parts of the 3D-model, and 

program code for causing a computer to adjust the arrangement of the at least one 
component, the arrangement of the cutting curve or. surface, and/or the formation of 
the connecting surface based on the result of said evaluation.- 



The computer program product is especially adapted for causing a computer to 
perform the operations of the method according to the first aspect of the invention 
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and may further comprise program code for causing a computer to perform any of 
the steps of any of the features of the method according to the invention. 

The computer program product may be in the physical form of a hard disc, a floppy 
5 disc, a magnetic data carrier, a ZIP, a smart card, a CD ROM, or a DVD. 

According to a further aspect the invention relates to a computer, data signal 
embodied in a signal wave, said computer data signal including a computer 
program, said program for causing computer-assisted modelling of customised 
]0 earpieces comprising at least one part being individually matched to an auditory 
. canal, said program comprising: 

program code for causing a computer to obtain a three-dimensional computer 
model, 3D-model, of at least part of the auditory canal, said 3D-modeI having an 
15 outer surface, 

program code for causing a computer to initially arrange at least one component in 
relation to the 3D-model, 

20 program code for causing a computer to initially arrange a cutting curve or cutting 
surface in relation to the outer surface of the 3D-m6del, said cutting curve or surface 
dividing the 3D-model in an outer portion and an inner portion, 

program , code for causing a computer to initially form a connecting surface 
25 connecting the at least one component and the inner portion of the 3D-model, said 
connecting surface thereby being part of the 3D-model, 

program code for causing a computer to perform an evaluation of the arrangement 
of the at least one component, said evaluation comprising a collision detection of the 
30 at least one component in relation to one or more parts of the 3D-model, and 

program code for causing a computer to adjust the arrangement of the at least one 
component, the arrangement of the cutting curve or surface, and/or the formation of 
the connecting surface based on the result of said evaluation. 
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The computer data signal is especially adapted for causing a computer to perform 
the operations of the method according to the first aspect of the invention and may 
further comprise program code for causing a computer to perform any of the steps . 
of any of the features of the method according to the invention. 

According to a further aspect the invention relates to a system for computer-assisted 
modelling of customised earpieces, said system including computer readable 
memory having one or more computer instructions stored thereon, said instructions 
comprising 

instructions operative to cause the computer to obtain a three-dimensional computer 
model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
outer surface, 



15 instructions operative to cause the computer to initially arrange at least one 
component in relation to the 3D-model, 

instructions operative to cause the computer to initially arrange a cutting curve or 
cutting surface in relation to the outer surface of the 3D-model, said cutting curve or 
20 surface dividing the 3D-model in an outer portion and an inner portion, 

instructions operative to cause the computer to initially form a connecting surface 
connecting the at least one component and the inner portion of the 3D-model, said 
connecting surface thereby being part of the 3D-model, 



25 



30 



instructions operative to cause the computer to perform an evaluation of the 
arrangement of the at least one component, said evaluation comprising a collision 
detection of the at least one component in relation to one or more parts of the 3D- 
model, and 

instructions operative to cause the computer to adjust the arrangement of the at 
least one component, the arrangement of the cutting curve or surface, and/or the 
formation of the connecting surface based on the result of said evaluation. 
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The system is especially adapted for performing the operations of the method 
according to the first aspect of the invention and may further comprise instructions 
operative for causing the computer to perform any of the steps of any of the features 
of the method according to the invention. 

5' 

Preferably the system according comprises a 3D scanner, a computer and a 
computer controllable rapid prototyping machine. Thereby is provided a complete 
system for scanning, modelling and prototyping customised earpieces. 

10 The rapid prototyping machine may be any rapid prototyping machine capable of 
being controlled by a computer. Examples include but are not limited to machines 
capable of performing 3D milling and/or stereo lithography/SLA and/or solid ground 
curing and/or selective laser sintering and/or direct shell production casting and/or 
3D-printing and/or topographic shell fabrication and/or fused deposition modelling 

15 and/or Inkjet modelling and/or laminated object manufacturing and/or nano-printing. 

The system may be arranged in different ways. Accordingly, the scanner and/or the 
prototyping machine may be connected to the computer via a local area network or 
the scanner and/or the prototyping machine may be connected to the computer via 
20 the internet 

Consequently the 3D scanner, the computer and the rapid prototyping machine may 
be placed in the same locality. Alternatively, the computer for modelling may be is 
placed at a "modelling site", where trained staff can perform the optional manual 
25 steps of the modelling. According to this embodiment, scan data can be sent via the 
internet or via other data transmission systems to the "modelling site*. 

Similarly, the rapid prototyping machine may be placed at a "rapid prototyping site", 
where the very costly machinery can be operated efficiently and on a 24 hour basis 
30 to keep production cx>sts low. 

The 3D scanner is conveniently placed by an audiologist or an otologist, especially 
when the scanner is a 3D structured light scanner for scanning the internal contours 
of the ear canal and/or meatus. 
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Preferably the system further comprises a database, wherein scan data are stored. 
According to an especially preferred embodiment, of the invention, the system 
comprises a further database, wherein 3D data for customised earpieces are stored. 
These databases can be accessed during modelling of the earpieces and are 
especially useful when the method is performed on a similarity based approach. 

The data are preferably stored together with information identifying the users of the 
customised earpieces. 

An optional further database, comprises 3D data for components from different 
manufacturers. These can also be used for the modelling process. 



Further optional hardware includes, but is not limited to spaceball TM tracking 
device to assist in manual or computer assisted, modelling and stereo glasses to 
15 assist in manual inspection of 3D computer screen models. 

According to a further aspect of the present invention there is provided a method for 
computer-assisted modelling of customised earpieces comprising, at least one part 
being individually matched to an auditory canal and/or a meatus, said method 
20 comprising the steps of: 

a) obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer surface, 

25 b) initially arranging a at least one component in relation to the 3D-model, 

c) initially arranging a cutting curve or cutting surface in relation to the outer surface 
of the 3D-model, said cutting curve or surface dividing the 3D-model in an outer 
portion and an inner portion, 



30 



d) initially forming a closing surface closing the hole partly or completely created in 
the 3D model by the cutting curve/cutting surface, 
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e) performing an evaluation of the arrangement of the at least one component, said 
evaluation comprising a collision detection of the components in relation to one or 
more parts of the 3D-model and/or other components, and 

5 f) adjusting the arrangement of the at least one component, the arrangement of the 
cutting curve or surface, and/or the formation of the connecting surface based on 
the result of said evaluation. 

According to the present aspect of the invention is provided a different method for 
10 modelling earpieces. If the closing surface is not completely closed and if the at 
least one component is places in the hole, the closing surface fulfils the same 
function as the connecting surface according to the first aspect of the invention. 
Another possibility according to this aspect of the invention is to model an 3D 
earpiece with a hole into which the components of the earpiece can be inserted after 
15 prototyping. It should be understood that the method of the second aspect of the 
present invention may be combined with any of the methods of the first aspect of the 
invention, wherein the components are arranged in relation to a cutting surface. 

This aspect of the invention may also be in the embodiment of a computer program 
20 product or a computer data signal embodied in a signal wave comprising computer 
program code for performing the method and in the embodiment of a system 
including computer readable memory having one or more instructions stored 
thereon, the instructions comprising instructions operative for causing the system to 
perform the method. 

25 

According to a further aspect of the present invention there is provided a method for 
computer-assisted modelling of customised earpieces comprising at least one part 
being individually matched to an auditory canal, said method comprising the steps 
of: 

30 

obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer surface, 

initially arranging at least one component in relation to the 3D-model f 
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initially arranging a cutting curve or surface in relation to the outer surface of the 3D- 
mode!, 

said cutting curve or surface dividing the 3D-model in an outer portion and an inner 
portion, 

said initial arrangement of the cutting curve or surface and the components being 
performed using a similarity-based approach, in which the present obtained 3D- 
model is compared to a number of stored models of previously generated optimised 
3D-models, with one of said stored 3D-models being selected as the most similar 
model and the initially arrangements of the cutting curve or surface and the 
components being set substantially equal to the optimised arrangements of the 
cutting curve or surface and the components of said most similar 3D-model. 

Here, the comparison of the present 3D-models and selection of the most similar 
3D-model may be computer controlled or computer assisted. Also, the selection of 
initial arrangement of the cutting curve or surface and components may be computer 
controlled or computer assisted. 

This aspect of the invention may also be in the embodiment of a computer program 
product or a computer data signal embodied in a signal wave comprising computer 
program code for performing the method and in the embodiment of a system 
including computer readable memory having one or more instructions stored 
thereon, the instructions comprising instructions operative for causing the system to 
perform the method. 

It is preferred that the method of this aspect of the invention further comprises the 
step of initially forming a connecting surface connecting the components and the 
inner portion of the 3D-model, said connecting surface thereby being part of the 3D- 
model. 



The method of the this aspect of the present invention should preferably further 
comprise the steps, of performing a collision detection of said arranged components 
in relation to one or more parts of the 3D-model, and adjusting the arrangement of 
the at least one component and/or the arrangement of the cutting curve or surface 
based on the result of said collision detection. Here, the adjustment of the 



WO 02/071794 PCT/DK02/00137 

19 

arrangement of the cutting curve or surface and/or the arrangement of the at least 
one component may be . repeated until the collisipn detection fulfils a required 
minimum criterion. 

5 According to a further aspect the invention relates to a method for computer- 
assisted modelling of customised earpieces comprising at least one part being 
individually matched to an auditory canal, said method comprising the steps of: 

obtaining a three-dimensional computer model, 3D-model, of at least part of the 
10 auditory canal, said 3D-model having an outer surface, 

initially arranging a at least one component in relation to the 3D-model, 

initially arranging a cutting curve or cutting surface in relation to the outer surface of 
15 the 3D-model, said cutting curve or surface dividing the 3D-model in an outer portion 
and an inner portion, 

said initial arrangement of the at least one component and/or cutting curve or 
surface being performed using a feature-based approach, in which features 
20 extracted from the obtained 3D-model are used for the arrangement. 

This aspect of the invention may also be in the embodiment of a computer program 
product or a computer data signal embodied in a signal, wave comprising computer 
program code for performing the method and in the embodiment of a system 
25 including computer readable memory having one or more instructions stored 
thereon, the instructions comprising instructions operative for causing the system to 
perform the method. 

For the embodiments of the first aspects of the present invention, the 3D-model, 
30 present 3D-model or previously stored optimised 3D-models may have an outer 
shell surface being parameterised by a number of vertices, which vertices are 
connected by triangles. For the embodiments using a similarity-based approach, the 
selection of the most similar 3D-model may comprise: 

35 extracting a number of features from the obtained or present 3D-model f 
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comparing said number of extracted features with corresponding stored features of 
a number of stored previously optimised 3D-mbdels, and 

5 selecting a number of stored 3D-models as candidates for the most similar 3D- 
model, said candidates being the stored 3D-models having the compared features 
being nearest neighbours, in a feature space, to the feature points of the present 
3D-model. . 

10 The selection process may further comprise: 

registration of the present 3D-model and the selected candidate 3D-models, 

selection of the most similar 3D-model as the model of candidate 3D-models having 
15 the smallest between the outer shell surface of said candidate 3D-model and the 
outer shell surface of the present 3D-model. 

It should be understood that the methods of the third aspect of the present invention 
may be combined with any of the methods of the first and second aspects of the 
20 invention using a similarity based approach. 

According to a still further aspect of the present invention there is provided a method 
for shelling a 3D model, said method comprising the steps of: 

25 obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer shell surface being parameterised by 
a number of vertices, which vertices are connected by triangles, and 

performing a shelling process to obtain a shelled 3D-model of at least part of the 
30 auditory canal, said shelling process comprising: 

offsetting inwardly a copy of each vertex in the outer shell surface, 

removing the number of copied vertices being closer to the outer shell surface than 
35 a given minimum shell thickness, and 
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creating an inner shell by triangulation of the remaining copied vertices. 

According to a further aspect the invention relates to a computer program product 
5 including a computer readable medium, said computer readable medium having a 
computer program stored thereon t said program for causing computer-assisted 
shelling of a 3D model, said program comprising: 

program code for causing a computer to obtain a three-dimensional computer 
10 model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
outer shell surface being parameterised by a number of vertices, which vertices are 
connected by triangles, and 

program code for causing a computer to perform, a shelling process to obtain a 
15 shelled 3D-model of at least part of the auditory canal, said shelling process 
comprising: 

program code for causing a computer to offset inwardly a copy of each vertex in the 
outer shell surface, 

20 

program code for causing a computer to remove the number of copied vertices 
being closer to the outer shell surface than a given minimum shell thickness, and 

program code for causing a computer to create an inner shell by triangulation of the 
25 remaining copied vertices. . 

According to a still further aspect the invention, relates to a computer data signal 
embodied in a signal wave, said computer data signal including a computer 
program, said program for causing computer-assisted shelling of a 3D model, said 
30 program comprising: 

program code for causing a computer to obtain a three-dimensional computer 
model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
outer shell surface being parameterised by a number of vertices, which vertices are 
35 connected by triangles, and 
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program code for causing a computer to perform a shelling process to obtain a 
shelled 3D-model of at least part of the auditory canal, said shelling process 
comprising: 

program code for causing a computer to offset inwardly a copy of each vertex in the 
outer shell surface, 

program code for causing a computer to remove the number of copied vertices 
0 being closer to the outer shell surface than a given minimum shell thickness, and 

program code for causing a computer to create an inner shell by triangulation of the 
remaining copied vertices. 

5 Furthermore, the invention relates to a system for computer assisted shelling of a 
3D model said system including computer readable memory having one or more 
computer instructions stored thereon, said instructions comprising: 

instructions operative to cause the computer to obtain a three-dimensional computer 
► model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
outer shell surface being parameterised by a number of vertices, which vertices are 
connected by triangles, and 

instructions operative to cause the computer to perform a shelling process to obtain 
a shelled 3D-model of at least part of the auditory canal, said shelling process 
comprising: 

instructions operative to cause the computer to offset inwardly a copy of each vertex 
in the outer shell surface, 

instructions operative to cause the computer to remove the number of copied 
vertices being closer to the outer shell surface than a given minimum shell 
thickness, and 
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instructions operative to cause the computer to create an inner shell by triangulation 
of the remaining copied vertices. 

Also here it should be understood that the shelling method according to the last 
5 aspects of the present invention may be used in any of the methods of the first 
aspects of the present invention in order to obtain a shelled 3D-model. 

The shelling algorithm according to the present invention makes it possible to 
perform shelling in a rapid and simple way. 

10 

Brief description of the drawings 

The invention will now be explained in more detail in conjunction with the enclosed 
drawings on the basis of various example embodiments in which: 

15 

Figure 1 shows an In-The-Ear Hearing Aid; 
Figure 2 shows a Completely-ln-Canal Hearing Aid; 
20 Figure 3 shows a wireless In-The-Ear Communication device; 
Figure 4 shows an In-The-Ear Adaptive earpiece; 
Figure 5 gives an overview of a full process and the hardware components; 

25 

Figure 6 shows two original 3D models of two impressions; 

Figure 7 gives an illustration of triangular based representation with the same 3D 
model visualized as shaded and as wire frame; 

30 

Figure 8 shows a simplified example of a modelling process and the involved 
modelling operations; 
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Figure 9 shows a simplified example of a modelling process and the involved 
modelling operations; 

Figure 1 0 shows a simplified example of the modelling process illustrated by images 
5 of the evolution of the model; 

Figure 11 illustrates a removal of a defects related to a thread, which are used to 
remove the impression from the ear; 

10 Figure 12 illustrates two simple virtual reference ear models created from the 
corresponding models shown in Figure 6; 

Figure 13 shows a 3D model before and after cutting and closing by a simple planar 
surface defined by control points and a surface orientation; 

15 

Figure 14 illustrates intersections between one model triangle and the surface 
triangles in a triangular-based representation of a 3D model; 

Figure 15 shows the cutting of the triangles between two pointes sampled on a 
20 curve and projected onto the 3D model. The cutting is performed by a local cutting 
plane; 

Figure 16 illustrates cutting and closing of the top of a shelled model with a planar 
surface with thickness equal to the shell thickness; 

25 

Figure 17 show a flow chart for the loop used for a manual approach for the 
component placement, cutting and filleting/lofting of the visible part of the surface; 

Figure 18 illustrates a manual placement of the component surface and the 
30 components -in this case an integrated battery and electronics; 

Figure 19 shows an example of collision between component and shell surface; 



35 



Figure 20 illustrates a spatial division of the space into cubes; 
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Figure 21 contains a flow chart for the loop used by a rule-based approach for the 
optimal component placement, cutting and filleting/lofting of the visible part of the 
surface; 

5 Figure 22 shows a cutting by a closed curve on the surface. The curve is defined by 
the number of control points; 

Figure 23 shows the first step in the illustrated loft operation, which is to determine 
the correspondence between the vertices at the two boundaries; 

10 

Figure 24 illustrates the result of lofting the model and component surface in Figure 
22 visualised alone and in the reference ear; 

Figure 25 illustrates the result of a lofted surface when the additional control points 
15 between the corresponding vertices have been moved backward along v c1 and v^ 
until they are located behind the surface of the reference ear; . 

. Figure 26 illustrates the result of a shelling; 

20. Figure 27 is a flow chart of a shelling algorithm; 

Figure 28 illustrates the proper offset of each vertex to ensure minimum shell 
thickness when using a vertex representation of a 3D model; . 

25 Figure 29 illustrates an IN-THE-EAR earpiece with an area in softer material; 

Figure 30 shows a manual cutting with a planar surface at the canal part of the 
surface followed by a filleting/lofting; 

30 Figure 31 illustrates a placement of components on the canal part of the surface. 
The components correspond to a sound outlet, the transducer and the tube, which 
connect the transducer and the outlet; 

Figure 32 is a flow chart for the loop used for the manual approach for cutting and 
35 component placement on the canal part of the surface; 
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Figure 33 illustrates a manual creation of a ventilation channel; 

Figure 34 shows an IN-THE-EAR earpiece with a double ventilation channel; 

Figure 35 shows an IN-THE-EAR earpiece with a feedback reduction chamber; 

Figure 36 shows an IN-THE-EAR Hearing Aid with variable shell thickness and 
holding spikes; 

Figure 37 illustrates the creation of a lock for the electronics and battery component; 

Figure 38 illustrates the creation of room for the faceplate with a planar backside by 
performing a cut with the surface corresponding to the backside of the faceplate; 

Figure 39 shows an example of identification placed on the inside of the shell or as a 
detachable tag; 

Figure 40 illustrates Boolean functions on two 3D models, A and B; 

Figure 41 illustrates a difference map showing the penetration of the reference ear 
by a final earpiece; 

1. Detailed description of the invention 

1.1 General definitions 

3D: A general abbreviation for three-dimensional. 

3D modelling operations: A number of different operations that alter the geometry 
of the original 3D model. These operations are used to change the outer and inner 
geometry of the earpiece. The 3D modelling operations are also used to make an 
optimal placement of the inner components of the apparatus. 
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3D model: A geometric representation of an object. This can either be an object of 
unique and complex geometry obtained by using a three dimensional scanning 
device or an object parametrically .generated using a traditional CAD system or 
another 3D modelling software program. Different types of representations of 3D 
5 models exist. In one of the most common representation the 3D model is 
parameterised by a number of vertices, which are connected by triangles, see 
Figure 7. 

Original 3D model: The 3D scan of the meatus and/or auditory canal before any 3D 
10 modelling operations have been performed on the model. This model is often 
generated by scanning an impression . of the auditory canal using an optical, 
acoustic, mechanical, or other 3D scanning apparatus. The original 3D model can 
also be obtained by using an intra canal 3D scanning device. 

15 Present 3D model: A 3D model that exists as a temporary step in the total 3D 
modelling sequence; The present 3D model can therefore be any representation of 
the 3D model between the Original 3D model and the Final 3D model. 

Final 3D model: A 3D model of the final earpiece. The final 3D model usually 
20 includes the geometry of the arranged components. Other useful geometric 
alterations, of the original 3D model are also, covered by this definition. 

Component: A general term used for any type of component, feature or unit used 
with , the device. Examples of components are ventilation channel, amplifier, 
25 microphone, vibration pick-up, microchip, transducer, wireless 
communication/identification devices, position sensors such as GPS, loudspeaker, 
tubes, battery, printed circuits, faceplate, surface patches, inlets, outlets, wires, 
conductors, volume controls, nail grip, extraction cord, tele coil, locking means, 
interface modules, identification and logo. 

30 

Cutting tool: A tool such as an arbitrary curve or surface used to divide the model 
into two portions, where one of the portions are cut away, see e.g. Figure 13 or 
Figure 22. 
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Earpiece: The earpiece includes housings for hearing aids, wireless or connected 
communication devices (headsets, mobile phones, personal agents), loud speakers, 
tinnitus masking devices, devices recording vibrations in the skull and transforming 
these into audio signals, voice recognition devices, earplugs, noise blockers with 
! selective frequencies or sound levels, Man Machine Interface (MMI) products that 
enable clear communication even in the noisiest environments, or products related 
to wireless Internet applications. 

Canal part of the surface: The canal part of the surface corresponds to the part of 
the model surface, which is inside the auditory canal, see Figure 6 

Inner shell surface: The surface corresponding to the internal part of the shell 
2603, see Figure 26. 

Outer shell surface: The surface corresponding to the outer part of the shell 2604, 
see Figure 26. 



Visible part of the surface: The visible part of the surface is defined as part of the 
model surface, which is partly or fully visible when the earpiece is inserted in the 
20 ear. 



Triangulation: The process of connecting vertices by triangles. 

Vertex: A point in the 3D space. The vertices are connected by edges forming 
25 simple polygons, e.g. triangles, see Figure 7. 

Connecting surface: A connecting surface (Figure 24, 2401) is a generated 
surface connecting a component with the inner portion of the 3D model. The 
connecting surface may also be defined as a generated surface connecting a 
component surface with the inner portion of the 3D model. In the .finished product 
the connecting surface may either be printed/produced together with the inner 
portion of the customised earpiece or it may be formed by milling it in a faceplate 
part (Figure 38, 3803) in which a component can be inserted. . 
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Cutting curve/surface: A cutting curve/cutting surface is a curve/surface defined by 
the user or the computer and dividing the 3D model into a outer and inner portion. 
See Figure 13! 1303 and Figure 38, 3801 for examples of a cutting surface and 
Figure 22, 2203 for an example of a cutting curve. 

5 . / . ■ • " " 

Outer portion/Inner portion: The terms are used to designate the two parts of the 
model that arise as a result of cutting of the 3D model with a cutting curve or 
surface. The inner portion is the portion of the model, which is closest to the meatus 
of the user. Figure 22 shows an example of a 3D model divided into an inner portion 

10 2206 and outer portion 2207. The outer portion of the 3D model may form a virtual 
ear. 

Component surface: The components are usually arranged in relation to a related 
component surface, which is then connected with the rest of the shell preferably by 

15 a cutting or loft operation. An alternative strategy is to create the component surface 
directly from the arranged components. The component surface is not necessarily 
an integrated part of the final 3D model. It could be a separate cover or faceplate, 
which is assembled with the shell later in the production process. Figure 18 
illustrates the arrangement of the component consisting of electronics and battery 

20 1801 and the related component surface 1802. 

1 .2 General specification of the system 

Figure 1 schematically shows an In-The-Ear hearing aid, which typically consists of 
a shell or otoplasty 101 closed by a face or cover plate 102, a control switch 103, a 

25 sound inlet 104, a microphone 105, an electronic amplifier 106, a feedback control 
device 107, a replaceable battery 108, a battery compartment 109, an transducer 
110, a sound outlet 111 and a ventilation channel 112. Figure 2 shows the smaller 
Completely-ln-Canal hearing aid, which consist of the same components with an 
additional removal handle 201. Another example of a device worn in the ear is the 

30 wireless communication device in Figure 3, which typically consists of a large 
number of similar components as the hearing aids and an additional microphone 
with vibration pickup 301 and a wireless transmitter 302. Finally is shown a simple 
adaptive earpiece in Figure 4, which typically consists of a shell 101, a ventilation 
channel 112 and a sound tube 401. 
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Figure 5 shows an overview of the full process for manufacturing of customised 
earpieces and the involved hardware. The hardware comprises a 3D scanning 
device 501, a computer 502 and rapid prototype machine 503. Additional hardware 
devices are a database server 504, a spaceball tracking device 505 and 3D stereo 
5 glasses 506. The process consists of three main steps: 3D data capturing, 3D 
modelling and 3D manufacturing. As indicated in Figure 5 3D data capturing, 3D 
modelling and 3D manufacturing can be performed at different physical locations to 
optimise cost and quality. Distribution is easily implemented, since the invention 
allows the original and final model to be transferred over the Internet. In general the 
10 invention is mainly focused on the modelling part. The individual operations will be 
described in details below. 

The optimal output of the system varies from application to application and must 
initially be specified by human interaction or intelligent suggestions from a computer. 
15 In the case of hearing aids, ear worn communication devices and other mechanical 
or electrical devices worn in the ear, the goal is usually to optimise the size, the 
visual appearance, the acoustic properties and the placement of the components 
inside the earpiece. A perfect fit to the users ear is always wished for. 

20 The system is implemented in two steps: initially the system requires input from an 
operator, and after a learning/training period the system may become fully or almost 
fully automated and may handle all steps with no or very little operator interaction. 
Manufacturers may get the system after the training has been performed to the 
specific application and may thus need virtually no human interaction to produce the 

25 desired result. . 

Often a quality assuring person or the user wiN judge the final earpiece and 
apparatus before it is physically produced by the system. 

30 1.3 3D data capturing 

The first step in the production process is to capture a 3D digital model of the 
impression or .directly of the auditory canal using a 3D scanning device. Two 
examples of original 3D models 601, 602 are illustrated in Figure 6. Note that the 
medium size model 601 only corresponds to the part of the large model 602, which 
35 is marked by a box. Note also the definition of the canal part of the surface 603, the 
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visible part 604 of the surface and which part that corresponds to the auditory canal 
605. Different types of representations of 3D models exist. Figure 7 illustrates the 
very common triangular-based representation, , where the 3D model surface 701 is 
parameterised by a number of vertices, which are connected by triangles 702. 

5 

The preferred embodiment of a 3D scanning apparatus for the given application is a 
non-contact system. The 3D scanning device is typically based on the projection of 
one or more sheets of light or another known pattern of light onto an impression of 
the ear. The source .of illumination is typically a low-power laser in the visibly light 
10 spectrum. Non-visible wavelengths can be used but this requires a sensor that can 
capture in the given spectrum. Non-contact 3D scanning of an ear impression can 
also be done using ultrasound, magnetic resonance or computer tomography (CT) 
scanners. 

15 3D optical scanners capture series of profiles or another known pattern of light from 
the illuminated auditory canal-impression. Most often the light pattern on the object 
is one or more distinct lines. These profile-lines are digitised in real time by an 
optical sensor. When the ear impression or the optics are moved, other profiles 
become available. With continuous motion, the 3D scanner automatically digitises 

20 object profiles from multiple views. Some 3D scanners can digitise an object's profile 
as dense as every 0.01 mm, which results in a highly detailed digital representation 
of the object being scanned. The ear impressions are preferably placed on fixtures 
and automatically fed to the scanner. One example of a suitable scanning apparatus 
and method is disclosed in PCT/DK01/00564 (3Shape). 

25 

3D scanners that do not require an impression of the ear can also be used in the 
present invention. These are using a probe that is directly inserted into the ear. The 
preferred probes do not touch the ear canal during the scanning process. The 
preferred probes either work by the use of ultrasound (WO 00/34739 Fagan et al.) or 
30 preferably the projection of a known light-pattern onto ^the auditory canal 
* (PCT/DK01/G0561,3Shape). 

The 3D scanner may also capture the texture of the impression. Capturing the 
texture can facilitate that text and marks can be drawn directly on the impression by 
35 the user or audiologist and read by the system or operator during modelling. This 
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enables e.g. the user to mark areas, which causes pain or special visual 
requirements. Marks and text can be extracted directly from the texture images 
using classic image processing operations such as adaptive threshold or edge 
detection. The extracted information can then be projected onto the model and 
processed, e.g. areas marked for causing pain can be projected onto the model and 
. material can be removed in the corresponding area. 

Other examples of information that can be marked on the impression include: 
marking of an arrangement of a cutting curve/surface; marking of an arrangement of 
the vent or exits for vent(s); marking of identification tag (name or identity of the user 
or audiologist); marking of soft and hard areas of the auditory canal; marking of an 
arrangement of components; marking of the arrangement of features of the outer 
ear. It is to be understood that when several different features are marked, these 
can be marked in different colour, which can be distinguished by the texture scan. 
Text writing can be recognised by OCR during the modelling. 

The captured 3D model may be saved in a database available in a local area 
network or over the Internet. 

"i 1.4 3D Modelling 

Figure 10 shows a simplified version of the modelling process illustrated with the 
evolution of the present model during the modelling. Figure 8 and figure 9 show two 
examples of the operations, which may be involved in the modelling process. The 
modelling operations 801-816 and 901-916 performed to create the final 3D model 
given the original 3D model are described in details below. Three examples are . 
included to show that the individual steps are not necessarily performed in the order 
described but can be performed in a number of different sequences with an equally 
satisfying result Different orders have different advantages. The system can also try 
the steps in a randomised order to iterate towards the best solution. Note that the 
modelling process usually is an iterative process, where different properties e.g. the 
positions of components or the path of the ventilation channel are changed a 
number of times until a satisfying result is obtained. 

The automation of the modelling software may be done using two approaches that 
can either complement each other or work single-handed. During the automated 
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steps the system can, at any time, request the input from an operator or switch to 
the other automation approach. 

Similarity-based approach 

One approach used to automate the system is to extract the necessary modelling 
information from a database. This database contains original 3D models of the 
auditory meatus and canal from different persons. For each original 3D model all 
operations and settings used to create an optimal final 3D model are recorded. 
When a new model needs to be processed the most, similar model is extracted from 
the database. Given the most similar 3D model, the computer software repeats the 
same sequence of operations that were performed on the extracted model in order 
to obtain the desired final 3D model. For successful use of the operations a 
registration, i.e. an alignment, of the new model to the extracted model may be 
performed. Details on the extraction of the most similar model are given in section 
1.4.18. Some operations and settings may need to be adjusted to compensate for 
different position, orientation and size between the two models. 

Most ear canals of a person are to a large extent a mirrored version of the opposite 
canal. A variant of the similarity-based approach is to apply the operations and 
20 settings for an already modelled ear to the opposite ear, i.e. apply the used 
operations and settings for the left ear to the right ear of the same person. The only 
difference is that the first ear and the applied operations and settings need to be 
mirrored, before it can be applied. The mirroring of the ear can be performed by 
mirroring the vertices in an arbitrary plane since the actual plane only changes 
25 orientation and position of the mirrored model. Likewise the operations and settings 
need to be mirrored in the same plane. 

Rule-based approach 

The other, approach incorporated in the system is to define a set of mathematical 
30 rules and implement these into algorithms that optimise the results of the individual 
steps in the modelling process. The optimal result of the individual operations takes 
into consideration the overall use of the final apparatus. The purpose varies with the 
application of the device. 
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1.4.1 Closing of holes 

Many scanning devices create original .models with holes in the surface, i.e. the 
model surface is not closed. Models with unclosed surfaces cannot exist from a 
physical point of view, so the holes need to be closed, due to e.g. occlusion effects, 
i In a triangular-based representation holes are determined by counting the number of 
triangles at each edge. The edge corresponds to a boundary if only one triangle is 
present on the edge. Boundary edges always create loops defining the hole in the 
surface. 
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Triangulation of hole 

In the case of triangular-based representation the following approach is preferably 
applied to close each hole. If the hole is small, e.g. defined by the boundary length, 
a triangulation is performed by directly connecting the vertices on the boundary by 
non-intersecting triangles. The triangulation is performed using a standard 3D 
triangulation method such as proposed by Hoppe et al. in "Surface Reconstruction 
from unorganised points", Computer Graphics, 26(2), 1 992, pp. 71 -78. 

Preferably the first step in closing large holes is to perform a fit of a parametric 
surface to the vertices on the boundary of the hole and the vertices in its 
neighbourhood. The parametric surface should preferably be smooth such as a 2 nd . 
3* or lower order surface, a NURBS surface or another type of spline surface. The 
neighbourhood may be manually marked or defined as the vertices in a certain 
distance from the boundary. To triangulate large holes new vertices are sampled on 
the fitted surface. These sampled vertices are then connected by triangles. One 
method for performing this operation is described in 1.4.7. The triangulated hole can 
be smoothed (see section 1 .4. 1 2) to improve visual appearance. 



1.4.2 Removal of defects 

A number of defects and artefacts are often present in the original impression and 
30 hence in the original 3D model. These defects originate from a number of different 
sources such as the impression creation, scars, tissue or hair in the ear, the thread 
used to remove the impression from the ear or small scratches and. cuts from the 
handling. Figure 11 shows defects 1105 originating from the thread. Other artefacts, 
such as bents on the ear channel, also need to be removed to obtain an earpiece,' 
35 which is pleasant to use. 
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Manual-based approach 

To remove defects the area containing the .defects may be marked using a proper 
selection tool. The choice of selection depends on the shape of the defect. A 
5 number of selection tools can be used based on point selections, rectangular 
selection, circle selections, brush selections, semi-copianar selection, flood 
selections, edge selections, rim selections and selections along a curve defined by a 
number of control points. 

10 In the case of the removal of the thread defect a curve-based selection 1106 is 
usually preferable and the thread is marked by placing a number of points along the 
defect. To remove the defect the marked triangles are removed and the hole 1007 is 
closed following section 1.4.1. Figure 11 shows the input model 1101, the selection 
of the defect 1102, the hole to close 1103 and the model 1104 with the defect 

15 removed. 

Other defects or artefacts are removed in a similar fashion, whereby the defect or 
artefact is marked and removed followed by a dosing of the hole (see section 1.4.1). 

20 Rule-based approach 

The ear. surf ace may be characterized by a soft and smooth surface. In contrast, 
defects may be characterized by sudden changes in the surfaces, which can be 
viewed as holes, valleys, peaks or ridges in the surface. These differences can be 
applied to detect defects. 

25 

In practice the local curvature can be calculated in each vertex. Areas containing 
defects are characterized by a high local variation in curvature. The local variation of 
the curvature in a vertex is calculated as the variance of the curvature in the vertices 
in the neighbourhood, e.g. first order neighbourhood. If the local curvature variation 
30 exceeds a predefined threshold a defect is assumed to be present The rest of the 
defect is traced by recursively including all neighbouring vertices with a local 
. curvature variation above the defined threshold. When the full defect has been 
traced, the included vertices and their corresponding triangles are removed and the 
hole is closed in the same manner as described in the manual approach. 

35 
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1.4.3 Creation of virtual reference ear 

A powerful tool for creation of visually appealing earpieces is to generate a virtual 
reference ear model. A simple virtual reference ear model is illustrated in Figure 12. 
Given a 3D ear model the present and final appearance of the earpiece can be 
5 visualized and the operator and user obtains a improved imagination of the effect of 
changing different properties, e.g. shape, size, colour, texture or components. The 
virtual reference ear also plays an important role in the automated cutting and 
placement of components. As a part of the creation of the virtual ear a coordinate 
system may also be inserted. The XY-plane in the coordinates system may be 
defined along the cheek with the Y-axis parallel with the body. The Z-axis should 
point into the ear cannel. 

Manual approach 

A simple virtual reference ear may be obtained by cutting the original model by a 
single surface such as a plane. Detailed descriptions of the cutting tools are found in 
section 1.4.4. The ear model in Figure 12 is created by a planar cut of the model in 
Figure 6. To obtain the most realistic impression of an ear the cut may be performed 
by a surface, which is parallel with the cheek. In the case of manual interaction the 
operator interactively defines the cutting surface by a number of control points on 
the surface of the original model. The number of control points required depends on 
the number of free parameters in the surface. In the case of a plane three points are 
required. Usually the XY-plane in the coordinate system is determined directly from 
the surface. However, two extra points need to be selected to determine the X-axis 
and the origo/Z-axis. 

Similarity-based approach 

In an automated scheme the cutting surface can be obtained as the surface applied 
to the . most similar model, which has been, extracted from the database. The 
coordinate system is determined in a similar way. 

Rule-based approach 

An alternative, automated strategy is to extract features, primarily lower order 
moments. These features are then fed to a neural network or another type of 
parametric or non-parametric model, which outputs the most likely plane. Such type 
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of approach requires a training set, which can be applied to train the neural network. 
The coordinate system is determined in a similar way, but with a separate neural 
network. 

5 An ear model only created from the original 3D model is limited to the size of this 
model. A larger model of the full ear or ideally the full head is desirable for optimal 
visualization of the visual appearance of the apparatus. Until full and precise 3D 
models of the human head become easily accessible, an ear or head model, which 
is locally similar to the original model (a so-called dummy head), can be extracted 
10 . from a database. The extracted model can be merged with the original, model and 
an improved visualization can be obtained. Another option is that a device, which 
captures the model directly without the use of impression, may capture the full 
geometry and texture of the ear and/or the head simultaneously. 

15 1.4.4 Cutting 

One of the first steps in the modification of the original model is usually to perform 
one or more cuts. Figure 13 shows a model before 1301 and after 1302 a cut with a 
single planar surface 1303 controlled by three control points 1304. The surface 
orientation 1305 defines what part of the model to remove. Finally the hole 
20 generated by the cut is closed by the surface. 

Cutting by a single surface 

Given an arbitrary surface, f(x, y ,z) =. 0, the cutting is performed by removing all 
parts of the present model, which are above/outside this surface, f(x, y ,z) > 0. To 
25 actually perform the cut all intersections between the model and the surfaces need 
td be determined and a cut is performed along these intersections. 

In a triangle-based representation a triangular version of the surface is assumed to 
be present. The first step is to remove the triangles with all vertices above the 

30 surface. The next step is to determine the intersecting triangles in the two models, 
see Figure 14. For each intersecting triangle .1401 in the . model the points 
corresponding to the intersections 1402 between the edges of this triangle and the 
surface triangles 1403 are determined. The possible intersection between an edge 
: and the triangle may be determined using Badouel's algorithm (Badouel, D., "An 

35 efficient Ray-Polygon intersection", Graphic Gems, pp. 390-393, 1990). Likewise, 
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the intersection points 1404 between this triangle and the edges of the surface 
triangles are determined. Together with the vertices 1405 of this triangle, which are 
below the surface, these intersection points form a closed loop of points. By a 
triangulation of this loop the. proper boundary of the surface cut is created for this 
particular triangle. All the points/vertices in the loop lie in the plane of the triangle, 
which limits the triangulation to two dimensions. Applying a standard 2D 
triangulation algorithm such as Delauney triangulation closes the hole. However, 
Delauney triangulation produces a triangulation of the convex hole, so the triangles 
outside the loop need to be removed (or never created). 



Repeating, this procedure for each intersecting triangle in the model creates an 
output model, which has been cut by a surface. Note that all triangles with all 
vertices below/inside the surface are left untouched. Refer to section 1.4.5 for 
details on how to reduce the number of triangle intersection tests by a subdivision of 
the space into cubes. 

Cutting by a curve on the surface 

As an alternative to cutting by surfaces the cutting can be performed by a curve. 
Figure 22 shows the model before 2201 and after 2202 cutting by a spline curve 
2203 defined on the surface of the model. The curve 2203 is defined by a number of 
control points 2204, which always lie on the surface of the.model. The control points 
and hence the curve can be manually adjusted by the operator. The orientation of 
the curve determines what part of the model to remove, i.e. the part of the model 
that is inside the curve is removed. The curve may also be controlled by other 
means than control points. 

To actually perform the cutting an ordered number of points are sampled along the 
curve. The individual points are then projected onto the 3D model e.g. using the 
triangle normal in the previous projected point. The normal in the first point is known 

from the first control point. Given these projected points, Pl p n 1501 on the 3D 

model (see Figure 15) the cutting is performed by cutting the individual triangles 
between Pi and p i+1 1501 by a local plane cut 1502. The cutting is performed by 
traversing the intersection points 1503 between the triangle edges and the local 
cutting plane between Pi and p M . Following the previous section a triangulation is 
performed of each loop consisting of the intersection points in an intersected triangle 
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and the triangle vertices 1504 below the cutting plane. The local cutting plane is 
defined by the point p and the cross product of vector from pi to p*i and the average 
triangle normals of the triangles, which pi and p i+1 is projected onto. The result of 
• cutting by a curve is illustrated in Figure 22. 

5 

Cutting by a single surface and closing the hole 

Usually models with closed surfaces are required; so the hole created by the surface 
cutting needs to be closed by the surface, i.e. the surface need to be cut along the 
intersections with the model and combined with the model. The procedure is 

10 equivalent to the one applied when the model is cut by a surface. The only 
difference is that the interpretation of surface and model is swapped. In this case the 
loops to be triangulated are created for all intersecting triangles in the surface. 
' Finally merging the pair of intersection points combines the surface and model, 
which has been cut, to form the output model. Note that there exists a one-to-one 

15 correspondence between all intersection points in the rhodel and surface, which has 
been cut. An example of surface cutting and closing is shown in Figure 13. 

Cutting by a surface with thickness and closing the hole 

In the case of a model with a shell thickness the cutting surface needs to have a 

20 thickness if the final shell thickness should not be violated. A shelled .model is shown 
in Figure 26. Refer to section 1.4.9 for details on shelling. Cutting by a surface with 
thickness and global orientation solves the problem with final shell thickness. Figure 
16 shows a model before 1601 and after 1602 cutting by a surface 1603 with 
thickness. The global orientation of the surface determines what part of the model to 

25 remove. 

Basically a surface with thickness comprises two non-intersecting independent 
single surfaces with opposite orientation and a constant or varying distance. The 
orientation of one of the single surfaces is equivalent to the global orientation. This 
30 single surface is defined as the outer single surface and the other as the inner single 
surface. Parts of the outer single surface correspond to parts of the outer shell 
surface after the cutting, hence the name. 

In practice the cutting of a shelled model by a surface with thickness may be 
35 performed as two independent cuts by the two single surfaces. The outer shell 
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surface of the shelled model may be cut and closed by the outer single surface 
us.ng the approach described in the previous section. In a similar way the inner shell 
of the shelled model may be cut and closed by the inner single surface, see Figure 
16. M 

1.4.5 Component placement on the visible part of the surface 

A very important operation for the visual appearance of the final earpiece is 
component placement on the visible part of the surface. The visible part of the 
surface is defined as the part of the surface, which is partly or fully visible, when the 
earpiece is inserted in the ear. The term components is not limited to traditional 
components such as electronics, buttons or battery devices, but can describe any 
type of units, functions or features of the earpiece, e.g. logo, surface patches or 
outlets connected to interior components. The placement is restricted by a number 
of factors such as collision between components and other parts of the model (e g 
shell, ear and other components), room for other components (e.g. ventilation 
channel, amplifier, microphone, vibration pick-up, microchip, battery, and printed 
crcuits). the angles of the components in the shell and the angles of the 
components with respect to the ear/head. The components are usualhy arranged in 
relaton to a related component surface, which is then connected with the rest of the 
shell preferably by a cutting or loft operation. An alternative strategy is to create the 
component surface directly from the arranged components. The component surface 
.s not necessarily an integrated part of the final 3D model. It could be a separate 
cover or faceplate, which is assembled with the shell later in the production process. 
Figure 18 illustrates the arrangement of the component consisting of electronics and 
battery 1801 and the related component surface 1802. 

Manual approach 

The flow chart of the manual approach for component placement and . the closely 
related cutting and filleting/lofting operations is illustrated in Figure 17. Note that this 
flow chart illustrates the order of the operations used in Figure 8. but many different 
orders of the operations could be applied; see e.g. Figure 9 or Figure 10. It is 
assumed that the relevant component surface and components such as amplifier 
microphone, vibration pick-up, volume control, microchip, battery and printed 
c.rcu.ts, have been selected from the component database. Usually simplified CAD 
models of the components are applied to reduce the computation time. Depending 
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on the type of component surface, the surface may also be an imported CAD model, 
e.g. a faceplate. 

The first step in the manual component placement is usually the placement of the 
5 related component surface 1802 with respect to the 3D model. However the 
component surface can also be created directly from the arranged components. The 
selected components 1802 are then placed in . relation to the 3D model and 
component surface by a manual arrangement of the component in the three 
dimensional space. The manual arrangement of the component surface and the 
10 components is usually an iterative process, where the position and orientation of the 
surface and components are alternately adjusted until an acceptable arrangement 
1705 is obtained. The present state of the model is visualised in the virtual ear (see 
section 1.4.3) to improve the evaluation of the visual appearance. The visualisation 
of the ear and the shell can be made transparent to further facilitate the placement. 
15 Note , that the parts of the components can be below, inside and above the 
component surface depending on the configuration. 

Independent manual placement of component surface and the components is a 
cumbersome and error prone task. Two tools may improve the performance of this 

20 task significantly. The first tool is to place and lock the components in relation to the 
component surface. When the operator adjusts the component surface the 
components keep the relative position to the surface, but change the position with 
respect to the 3D model, The position of component and component surface may be 
temporally unlocked and the relative position of the components adjusted. In this it is 

25 often an advantage to restrict the component to stay on the surface. 

The second tool is collision detection 1704, where a test is performed for collisions 
between the components and the relevant parts of the model. Figure 19 illustrates 
the collisions 1903 between shell surface 1901 and the component 1902. Typically 

30 the collision detection is performed with respect to the virtual ear; other components 
and the part of the present shell, which has not been removed by. the cutting. "One 
approach to collision detection is to perform a brute force test for inters<ections 
between the surface of the model and the component model. In a triangular-based 
representation the triangles in one model need to be tested for intersections with the 

35 triangles in the other model. An exhaustive intersection test between all triangles in 
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the two models is very computational expensive. Note that real time collision 
detection is almost mandatory, if the tool should be attractive. To reduce the 
computation time and facilitate real time collision a spatial subdivision of the 3D 
space into cubes (Fujimoto et al., "Arts: Accelerated ray-tracing system", IEEE 
5 Computer Graphics and Applications, 6(4), pp. 16-1 4, 1986) is performed, see Figure 
20. Each cube holds a list of all the triangles, which have parts inside it. 

Assume that the cube structure has been created for a model. If an intersection test 
needs to be performed between a new triangle and this model, only intersection 

10 tests between the new triangle and the triangles, which correspond to the cubes with 
parts of the new triangle inside, need to be performed. This method can be applied 
to perform a very fast test of all the triangles in one model with all relevant triangles 
in another model. Hence the full intersection test between the two models is 
performed. Based on the collision detection the penetration of one model into the 

15 other is determined. The 3D model used for collision detection may be an offset 
version of the original component to facilitate a minimum distance is not violated. 
The offset distance usually corresponds directly to the minimum distance. 

Hierarchical collision detection may also be used to obtain low computation times, 
20 e.g. by the use of bounding volumes. Preferably the bounding volume should be 
spheres, axis-aligned bounding boxes, oriented bounding boxes, k-DOPs (discrete 
orientated polytopes), pie slices or spherical shells. 

An alternative strategy to collision detection is to measure the local or global 
25 distanbe from the component surface to the relevant parts of the model. This type of 
collision detection has a large degree of freedom, since collision also is detected if 
the components violate a minimum distance to the relevant parts of the model. This 
is very relevant in the case of required collision detection with respect to the inner 
shell surface, before the surface is actually created. 

30 

In the case where there is not enough space for the components the shell may be 
modified in the collision regions to make more room. One way of doing this is to 
remove material from the shell using a Boolean function, such as subtracting the 
colliding part of the component from the shell, provided that the component does not 
35 penetrate the shell. Another option is to use an iterative offset which is repeated 
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until room enough has been created for the component - again with the constraint 
that the component should not penetrate the shell. 

Refer to section 1.4.17 for details on how to add and remove material. Modifying the 
5 shell outwardly will make the final model intersect with the ear. However this may be 
a minor problem for limited modifications, especially if these are performed in the 
soft parts of the ear. 

Similarity-based approach 
* 10 Extracting the most similar model and applying the same position and orientation of 
the component and the related component surface can automate the placement of 
the surface and the components. The collision detection presented above can be 
applied to ensure that no collisions are present If collisions exist one of the other 
approaches can be applied. 

15. 

Rule-based approach 

An alternative strategy for the automated placement of components is to apply an 
object function, f(v), which expresses the quality of the placement, v, of the 
components (and the closely related component surface, cutting and filleting/lofting 

20 operations). The flow chart of this approach is shown in Figure 21. The optimal 
placement, v*. of the component surface and components can then be obtained by 
determining the placement, which optimises the criterion, f(v*) < f{v) Note that the 
parameters, v t in Figure 21 usually also contains the free parameters related to the 
cutting and filleting/lofting operations. The optimisation can be constrained by a 

25 number of factors such as collision between components and shell, room for other 
components and features (e.g. ventilation channel, amplifier, microphone, vibration 
pick-up, microchip, battery, and printed circuits), the angle of the component in the 
shell and the angle of the component with respect to the ear/head. The. constraints 
can either be incorporated as hard or soft constraints, where a penalty function is 

30 incorporated into the objective function. In practice soft constraints can act as hard 
constraints if a very, high penalty is assigned for violation of the constraint, e.g. a 
collision. 



35 



The object function, f(v), may consist of a weighted sum. of the terms related to the 
soft constraints and a number of other terms which express the quality of the 
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earpiece. Preferably these terms are the volume of the shell, the outer shell surface 
area, the visible shell surface, area, the length of intersection between the reference 
ear and the cutting surface, the area of the cutting surface after the cut, the maximal 
penetration of the reference ear by a component, the average of the penetration and 
the acoustic properties. As seen in Figure 21 the object function is usually evaluated 
after the component placement, cutting and filleting/lofting operations have been 
performed. (However f(v) could be evaluated at any time after the parts to evaluate 
have are present in the model. The weights on the individual terms can be manually 
selected, based on empirical evidence or learned from a training set. 

General-purpose optimisation methods such as steepest descent, conjugated 
gradient, quasi-Newton methods, Newton methods, dynamic programming, simplex 
methods, pattern search, generic algorithms, simulated annealing and stochastic 
diffusion can be applied to determine the optimal placement. Most of the 
optimisation algorithms are iterative methods and require an initial configuration, v 0 , 
which is generated manually or automatically 2101, see details below. Given a 
placement, v, a collision detection 2104 is performed followed by an evaluation of 
f(v) 2105. If the relative improvement is below a specified threshold, £, 2106 the 
algorithm is finished otherwise the placement is updated 2207. The main difference 
between the optimisation methods is the way the placement is updated 2207, v M = 
g(Vj); during the optimisation. 

An alternative to apply general-purpose optimisation methods is to use pseudo 
physics for the optimisation. Preferably a simplified physical model of the system is 
formulated. This pseudo physical model can be very powerful for updating of 
component placement when the component collides with another component or the 
shell. In practice the model may be applied to make the colliding component 
"bounce ofT the shell or another component. Classic physics can be used to perform 
this type of . modelling e.g. combined with approximate surface normals in the 
collision regions. Some object function has direct physical model, interpretations. In 
this case the full optimisation can be performed in the physical framework. In most 
case however the physical modelling is combined with general-purpose optimisation 
methods, e.g. by applying physics for collisions and otherwise general-purpose 
optimisation methods. 
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Penalties may vary over the ear e.g. penetrations in soft parts of the ear obtains a 
lower penalty than in hard parts of the ear or penetration of parts of the shell 
consisting of hard material receive lower penalties than penetration of harder 
regions. The different penalties are obtained by assigning different weights to the 

5 relevant parts of the ear. These weights are then multiplied on the initial penalty 
corresponding to the same parts of the ear as the weights. High weights lead to high 
penalties. In the case of penetrations of hard and soft parts of the ear, the hard and 
soft parts of the ear will be assigned high and low weights, respectively. The weights 
can be input by an operator or obtained automatically from the most similar model in 

10 the database. In the case of weights related to anatomical features of the ear, the 
weights can be obtained by a registration of the model to an anatomical atlas from 
which the weights can be derived. The anatomical atlas can either be based on a. 
single standard ear or different standard ears for different groups. The weights can 
also be determined based on the dynamic variation of the ear and especially the ear 

15 canal under different circumstances, e.g. with open and closed mouth. The 
dynamics are preferably derived from a set of different models of the same ear using 
shape statistics. The set of different models should have been captured under 
different circumstances. An alternative strategy is to modify the reference ear by 
adding or removing material (see section 1.4.17) to change the penalties in the 

20 object function. 

A selection tool may also be used to assign different materials for the earpiece to 
different parts of the 3D model. Thus, one problem with earpieces is that they are 
exposed to sweat from the surface of the auditory canal and/or the meatus. Parts of 

25 the earpiece in contact with the skin of the wearer can thus be marked and 
prototyped using a particularly sweat resistant material, while the other parts are 
made in another material, which needs not be sweat resistant The selection of such 
materials are known to the person skilled in the art of earpiece manufacturing. 
Similarly, it may be advantageous to select materials, which are non-allergenic to 

30 those parts of the model being in contact with the skin of the wearer. The selection 
can be performed by a rule based approach, according to which surfaces within a 
certain distance from the skin of the wearer are selected. 



For some devices a number of different components exist with the same 
35 functionality, e.g. different transducers. To determine the optimal component each of 
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the possible components are selected and the placement is evaluated and optionally 
optimised using the described procedure. The component, which obtains the lowest 
value of the optimised object function, is selected by the system as the best 
component. A similar procedure can be used for automated selection of the 
components in the manual approach. 

Initialisation of the component placement is crucial to the success of the later 
optimisation. Preferably the initialisation is performed by the similarity-based 
approach or a feature-based approach, where extracted features are used for 
positioning. One way to perform the feature-based initialisation is to slice the part of 
the present model into a number of slices. Preferably these slices have 
approximately the same orientation as the preferred component orientation e.g. with 
respect to the canal. Each slice may then be analysed. This analysis may be 
performed by examining whether the components or a derived bounding box can be 
placed approximately inside the slice. The analysis is usually subject to a number of 
constraints, e.g. the angle of the components. A slice fulfilling the criteria is then 
used for initialisation - typically the slice closest to the canal. Based on the previous 
analysis the component is placed, e.g. by aligning the centroid of the component 
with the centroid of the slice. More details on features can also be found in section 
1.4.18. 

1 .4.6 Cutting the visible part of the surface 

In close relation with the placement of the component on the visible surface is 
usually performed a cutting of the visible part of the surface, which removes the 
unwanted part of the visible surface: The cutting is performed as described in 
section 1.4.4. The cutting of the visible part of the surface using a curve-based 
cutting tool is shown in Figure 22. 

Often the components or component surface is used to generate an initial cutting 
curve or surface, which can be adjusted by the operator. In some cases the cutting 
is performed directly by the component surface or a curve/surface derived from the 
components or component surface, e.g. a surface estimate of the component 
surface shifted in parallel toward the canal of the model or by forming a curve from 
points projected from the component or component surface onto the shell surface. 
Alternatively the cutting can be performed more or less independently of the 
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component and component surface. If the component surfaces and shell surface are 
not combined during the cutting, the two surfaces may be connected using the loft 
operation (see section 1 .4.7). 

5 In the case of the similarity based scheme the cutting tool and position is directly 
derived from the most similar model. In the case of the rule-based approach the free 
parameters of the cutting is included in v and changed to optimise the formulated 
object function, f(v). The cutting parameters are usually initialised from the 
component surface and may also be locked to the component surface to reduce the 
10 number of free parameters to optimise. 

1.4.7 Filleting/Lofting 

Filleting is the process of rounding or smoothing an edge. Edges are undesirable 
features in earpieces, where smooth and round surfaces in general are preferred. 
15 Filleting is illustrated in Figure 30. Lofting is the process of connecting two surfaces 
by a new surface. As shown below fillet and loft are closely related. 

A very powerful approach to fillet is to remove the triangles 3008 in a neighbourhood 
J on and around the edge 3006 and fit a parametric surface to the neighbourhood of 

20 * the hole created by the removed triangles. The surface should preferably be a 
. smooth surface such as a 2 nd , 3* or lower order surface, a NURBS surface or 
another type of spline surface. New vertices are then sampled on the fitted surface 
and connected by triangles. What triangles to remove may be determined by 
removing all triangles, parts of triangles and /or vertices in a certain distance from 

25 the edge or by directly selecting the proper neighbourhood 3003, e.g. limited by two 
curves 3007 - one on each side of the edge, see Figure 30. The curves can be 
manually adjusted by a number of visual control points. 

When the triangles have been removed the fillet usually turns into a loft operation, . 
30 where the boundary of two surfaces need to be connected. Note that the loft 
operation in general can be applied to connect two surfaces. The first step in the 
illustrated loft operation is to determine correspondence between the vertices 2301 
at the two boundaries 2302, 2303, see Figure 23. The correspondence may be 
determined by an exhaustive search for the correspondence that yields the lowest 
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average distance between the corresponding vertices under the constraint that the 
order of the vertices is preserved. 

The illustrated loft is based on a cubic B-spline surface, which requires a number of 
5 control points to be specified. For each vertex is calculated the vector, v c , which is 
perpendicular to the vertex normal and the boundary orientation vector in the vertex. 
The vertex normal is calculated as the area weighted average of the triangle 
normals of the triangles connected to the vertex. For each vertex in the set of 
. corresponding vertices two control points are created as the vertex ± v c . An 

10 additional control point is then created as v c1 and v^ added to the midpoint between 
the corresponding vertices pi and p 2 . Beside the created control points the two 
vertices also act as control points. When this process has been repeated for all sets 
of corresponding vertices, the surface is fully defined by the controls points. New 
vertices are then sampled on the surface, i.e. by sampling the vertices on the spline, 

15 which connect the corresponding vertices. Given these vertices and the ordering of 
the corresponding vertex sets, the neighbour relationships between the sampled 
vertices are known. Knowing these relationships makes it straightforward to connect 
the neighbouring vertices by triangles. The result of a loft is shown in Figure 24 and 
Figure 30. 

20 

When the fillet/loft has been applied to the model it is not ensured that the reference 
ear model is not penetrated by the connecting surface 2401, see Figure 24. This 
penetration 2402 can however be minimised by moving the control points behind the 
surface of the reference ear. Figure 25 shows the reduced penetration 2501 
25 obtained by moving the additional control point between the corresponding vertices 
backward along v c1 and v^ until it is behind the surface of the reference ear. 

A number of alternative approaches exist for a fillet operation. The simplest 
approach to fillet is to apply the smoothing on the edge and its neighbourhood. 
30 Refer to section 1 .4. 1 2 for details on smoothing. 

Another approach contracts cylinders with a predefined radius as close to the edge 
as possible without letting them pass through the surface. The surface is then 
projected onto the cylinders in these areas forming a rounded edge with constant 
35 curvature. Alternatively the triangles in the neighbourhood around the edge can be 
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removed and new vertices can be sampled from the cylinder surface. Note that the 
radius can vary along the edge. 

1.4.8 Cutting and filleting of the canal part of the surface 

5 . Like the visible part of the surface a cutting tool is usually applied at the canal part of 
the surface to remove unwanted portions of the surface, see Figure 30. The cutting 
can be performed by any of the cutting tools described in section 1 .4.4. However the 
cutting is usually performed by a planar surface 3005, which is also used to close 
the hole after the cutting. In the manual approach the operator dan select and adjust 

10 the cutting tool. . 

If the similarity-based approach is applied, the same cutting tool and position as 
applied to the most similar model is used. For the rule-based approach the position 
and orientation of the cutting tool is combined with the position of the components to 
15 be placed on the canal part of the surface. These free parameters, v, are then 
optimised with respect to an object function, f(v), similar to the one used in the 
placement of the component on the outer part of the surface, see also section 
1.4.10. 

20 Following the cutting a filleting operation 3004 (section 1.4.7) is performed on the 
cutting edge 3006, i.e. the edge where the cutting of the model has been performed. 
Figure 30 illustrates the full process of cutting 3001 ,3002 and filleting 3003,3004 the 
canal part of the surface. 

25 1.4.9 Shelling and surface offset 

The. original 3D model only consists of outer surface, but most final 3D models 
require a shell, so a shelling operation may need to be performed. Figure 26 shows 
a model before shelling 2601 and after shelling 2602. The outer shell surface 2603 
corresponds to the input surface, so only an inner shell 2604 needs to be created. 
30 The operator defines the thickness of the shell. For many devices it is crucial that a 
minimum shell thickness is guaranteed. 

An overview of a shelling algorithm js shown in Figure 27. The first step 2701 in the 
algorithm is to create a copy of each vertex in the outer shell surface. Figure 28 
illustrates how the new vertex 2801 on the inner shell 2802 is created along the 
35 scaled normal 2803 of the corresponding vertex 2804 in the outer shell surface 
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2805. The vertex normal 2803 is calculated as the average of the normals of the 
connected triangles weighted by their area. If the minimum shell thickness 2806 has 
to be ensured it is not sufficient to offset the vertex with the specified shell thickness. 
However the offset, which locally ensures the shell thickness, can be found as the 
5 maximum scale factor, which projects the scaled version of the vertex normal onto 
the full length of the triangle normals scaled by the predefined thickness. Only the 
normals of the triangles connected to the vertex are of relevance. Unfortunately, the 
proposed offsetting only ensures a local shell thickness.. In areas with convex 
surfaces and high curvature the offset vertices tend to violate the minimum shell 

10 thickness, these violating vertices are removed in the second step 2702 to ensure a 
proper shell thickness. Finally, the new inner shell may then be created by a 
triangulation 2703 of the created vertices. The triangulation may be performed using 
a standard 3D triangulation method such as proposed by Hoppe et al. in "Surface 
Reconstruction from unorganised points", Computer Graphics, 26(2), 1992, pp. 71- 

15 78. 

The proposed method may easily be extended to shells with a varying thickness by 
applying a local thickness in the offsetting of the individual vertices. Using a 
selection tool different materials can also be assigned to different parts as shown in 
Figure 29, where a softer material 2901 is assigned to the part of the shell, which 
20 corresponds to the hard or changing part of the ear, e.g. part that changes when the 
mouth is opened and closed. For details on how to assigning different properties to 
different parts of the model refer to section 1 .4.5. 

The shelling algorithm may also be used to offset e.g. the outer surface. A small 
25 offset of the outer surface may be necessary to ensure, that the final shell has a 
perfect fit. The only difference in applying the shelling method for offsetting is that 
the original model is removed after the offset surface is created. Local offsets of 
parts of the shell can also be performed, e.g. to create O-rings on the canal part of 
the shell. 

30 

1.4.10 Component placement on the canal part of the surface 

The component placement of the canal part of the surface is very important for a 
proper functionality of the apparatus and a pleasant insertion and pleasant use of 
the apparatus. The canal part of the surface corresponds to the part of the surface, 
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which is inside the .auditory canal. The term components should again be interpreted 
' in a broad sense, e.g. an outlet connected with a tube to a transducer. Figure 31 
shows the result of cutting and placement of an outlet 3103 connected with a tube 
3102 to a transducer 3101. 

5 

Manual approach 

A flow chart of the manual approach for component placement and the closely 
related cutting, lofting and shelling is shown in Figure. 32. Note that this flow chart 
illustrates the order of the operations used in Figure 8, but many different orders of 
10 the operations could be applied; see e.g. Figure 9 or 10. When placing components 
with multiple parts the parts can be adjusted simultaneously or individually. A 
. component with multiple parts (outlet, tube and transducer) is shown in Figure 31. 
Relevant measures such as the length of the tube can be extracted directly for later 
use, e.g. in a manual assembling. 

15 

However, it is usually not sufficient that there is room inside the shell for the 
components. The components should also be able to enter this room. This may not 
be the case if the auditory canal is too narrow in some parts. To facilitate the 
placement of components a valid path tool 3206 may be devised for determining the 

20 existence of a valid path along which the component is able to move. A minimal path 
algorithm combined with collision detection may be applied to determine this path. 
Depending on the material properties of the components and the shell some 
intersection may be allowed. The legal degree of intersection can be specified, e.g. 
by the allowed amount of penetration or by the allowed amount of deformation of 

25 shell and component, which is required to make the component pass. The 
deformations may need to be modelled, e.g. by finite element models. 

If no valid path exists removal of shell material in collision regions is possible 
following section 1.4.17. Collision regions are defined as the regions, where the 

30 component gets stuck. To facilitate the manual removal of material, the critical 
region is visualized and the neighbourhood is marked. However the valid path tool 
suggests the required local changes by removing material until the component is 
able to pass. These changes can either be accepted by the operator or accepted 
automatically under the constraint that the defined absolute minimum shell thickness 

35 is not violated. 
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The placement of the components may also be subject to other constraints e.g. the 
angle of the outlet with respect to the ear canal. 

5 Similarity'based approach 

The most similar model is extracted from the database and the same positions for 
components are applied. When the components have been placed the valid path 
tool is applied including the automatic modifications of the local shell thickness - if it 
is enabled. 

Rule-based approach 

The rule-based .approach applies the similar methods as the rule-based approach 
for component placement on the visible surface. The main difference is that a valid 
path tool may be applied during the optimisation and invalid configurations are 
rejected/heavily penalized. A similar type of object function is also used. However 
the weights of the individuaf terms in the object function may be changed to fulfil the 
specific requirement of the inner surface. Additional terms can also be added, e.g. 
the angle of the outlet with respect to the ear canal and the length of the tube 
connecting .the outlet and transducer. 

Preferably the optimisation of the placement is performed by a general-purpose 
optimisation algorithm, by pseudo physics or a combination of both. The initialisation 
may be performed by the similarity-based approach or a feature-based approach, 
where extracted features are used for placement. One way to perform the feature- 
based initialisation is to slice the canal part of the present model into a number of 
slices approximately orthogonal to the local canal orientation. The first slice of the 
canal, which is reasonably close to orthogonal to the canal surface and 
approximately able to contain the components optionally including filleting and 
ventilation channel, is applied for initialisation. If a planar cutting is performed on the 
canal part, then the initial cutting plane may be identical to the slicing plane. The 
components may be placed with respect to the centroid and orientation of the slice. 

1.4.11 Placement of pressure ventilation channel or sound bore 

For some devices placed in the ear a pressure compensation/ventilation channel or 
a sound bore connecting the inside and the outside of the ear is required to obtain 
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proper performance and pleasant use. Figure 33 illustrates a model 3301 with a 
ventilation channel 3302. Traditionally this channel runs inside the shell, on the inner 
shell, on the outside or a combination of all. 

5 Preferably the first step in creating the ventilation channel or sound bore is to 
determine the exit points on the canal and the visible part 3301, 3.303 of the surface 
of the shell and the path 3304 connecting these points. The skin of the user must 
not cover the exit points and the bending of the channel may be constrained to 
ensure proper functionality. Further the path of the ventilation channel may be 
10 constrained by a minimum shell thickness, intersection with placed components and 
a requirement of leaving the outer shell surface unchanged. 

Given the exit points and a legal path, the channel may be created by first adding a 
solid object, defined along the path, to the inner surface of the present model. The 

15 addition and later subtraction may be performed using a Boolean function, see 
section 1.4.16. The shape of the object may be defined by offsetting the specified 
shape of the ventilation channel or sound bore by the minimum shell thickness. In 
the case of a tube shaped ventilation channel or sound bore the solid object may 
correspond to a solid tube with a diameter equal to the sum of the ventilation 

20 channel diameter and the minimum shell thickness. A second solid object with the 
specified shape of the ventilation channel or sound bore defined along the path may 
be created and subtracted from the model, creating the final ventilation channel. In 
the case of a tube the second solid object corresponds to a tube with the specified 
diameter. Note that this method can generate ventilation channels with an arbitrary 

25 geometry, e.g. ventilation channels with cross sections of the following types: 
elliptical/circular, square/rectangular, T-shape, semi-circular with an edge, triangular 
with an edge, circular/elliptic with an edge. Ventilation channels with e.g. elliptic 
shape can make the channel stay in the shell and increase the space for 
components etc. Likewise the method facilitates the creation of almost any type of 

30 bores such as large bores, small bores, open bores and fish mouth bores. 

Note that the method describes the generation of a single ventilation channel or 
sound bore connecting the inner and outer surface. However the approach can 
easily be generalized to multiple channels (see Figure 34) and short channels not 
35 necessarily leading the whole way from the inner to the outer surface. The method 
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can also be used to generate ventilation channels or on the surface by not offsetting 
the points. Likewise, the approach can change shape and add extra features like a 
chamber along the channel by changing the shape of or adding the feature to the 
solid object, which is used to create the channel. Figure 35 schematically shows a 
5 chamber 3501 in the channel. The chamber is used to improve acoustic properties 
and reduce pressure. 

The possibility to design ventilation channels or sound bores with arbitrary shapes 
and paths, e.g. around the surface, can be applied to improve the acoustic 
10 properties and increase the protection towards earwax. Acoustic conductors 
integrated into the shell can also be created in the same way as the ventilation 
channels. Finally the acoustic properties of the ventilation channel or sound bore 
can be simulated and evaluated. 

15 Manual-based approach 

In the manual approach the operator may mark the exit points 3301 and a number of 
ventilation channel control points 3304 on the surface to define a sparse sampling of 
the path. Given these points, a continuous representation of the path may be 
created by fitting a curve, e.g, a spline. Before the curve is fitted, the points may be 

20 offset from the surface to ensure a proper shell thickness. Refer to section 1.4.9 for 
details on offsetting of points. The legality of the path with respect to intersections 
with components etc. may be determined using collision control and may visually be 
indicated to support the manual placement of the channel. If the path is illegal, the 
operator can move the individual control points to change the path until a legal 

25 configurations is obtained. When the points are adjusted the channel may be 
simultaneous visualized and illegal parts visually indicated. New points can also be 
added to define a more precise path. 

Similarity-based approach 

30 The most similar model previously extracted from the database may contain 
information defining the exit points as well as the points specifying the path. In some 
cases the viewpoint of the operator (position and orientation) used during the 
selection of each point is stored with the model. By applying these viewpoints to the 
present model, the corresponding points on the present model can be obtained. 

35 Given the points on the present model the ventilation channel can be generated. 
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An alternative strategy is to project the points from the similar model onto the 
present model to obtain the exit points and the path. The projection is performed 
along the surface normal. By applying the projected exit points and the path, the 
5 ventilation channel is created. . 

Rule-based approach 

In the automated scheme the exits of the ventilation channel may be placed given a 
preferred position. To make the position applicable to different models, the position 

10 is typically given relative to relevant landmarks such as surfaces or components. 
These positions can either be obtained by analysis of a training set or directly 
inputted by an operator. Preferably the path is generated using a shortest path 
algorithm, a "water flow" algorithm that determines the most southern path following 
the local canal bending or by sub sampling the line connecting the exit points and 

15 projecting these points onto the shell (following section 1.4.4). Ail path generation is 
subject to the previously mentioned constraints. Given the exit points and the path 
the final ventilation channel is created. 

In the case no legal path can be generated for the first exit points, a number of other 
20 exit points may be tested. These points can e.g. be generated from a training set, by 
an operator or by permutations of existing points. 

1.4.12 Optimise visual appearance 

The visual appearance is one of the most important properties of the earpieces for 
25 the users. Hence it is crucial to optimise the visual appearance. Beside the 
optimisation performed during the previous operations a number of additional 
operations may be applied: 

Smoothing or Fairing 

30 The smoothing or fairing may be performed by a low pass filtering of- the model 
surface followed by anti-shrinkage step. The anti-shrinkage can be required, 
because a low pass filtering shrinks convex parts of the surface. The low pass 
filtering may be performed by assigning a new position equal to the weighted sum of 
the vertex and its neighbours to each vertex. One way to perform the anti-shrinkage 

35 is to preserve the volume by scaling the full model. The defined number of iterations 
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corresponds to the degree of smoothing. The smoothing can either be performed on 
the full model or on selected parts. 

Colouring and texturing 

One of the last actions is to assign colours or texturing to the shell. The colours and 
the textures can be measured as a part of the scanning process or separately if 
impressions are scanned. Additional colours and textures can be sampled from a 
standard colour palette and a texture database, respectively. 

1.4.13 Optimise shell geometry 

When all components have been placed and all surface modifications have been 
performed, the shell geometry can be optimised. One objective of the optimisation is 
to improve the positioning of the components and increase the strength of the shell, 
see Figure 36. 

The positioning of the components may be improved by adding holders 3501 or 
extra material, which fits the exact geometry of the components. Holders such as 
spikes or rings, may be directly added by Boolean operations, see section 1.4.16. 
The holders may have vibration-reducing properties. Parts of bounding boxes or 
component negatives can also be used to add extra material, which fits the 
component. The addition may again be performed using a Boolean addition. 



Adding extra material (see section 1.4.17) also increases the shell strength and 
compensate for limitations in the physical production process. The strength of the 

25 shell can also be improved by increasing the local shell thickness in non-critical 
regions as described in section 1.4.9. Grids, ribs, or other features can also be 
created on the inner shell, e.g. by a projection of the features on the inner shell 
followed by a Boolean addition. Again the objective is to strengthen and stabilise the 
shell. All modifications are constrained by collision detection and no valid paths are 

30 violated. 



For some applications e.g. hearing aids it may be relevant to add extra material on 
parts of the outer shell surface to make the earpiece fit better and improve 
acoustics, e.g. by removing feedback. Preferably these areas are identified by the 
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operator, anatomical knowledge or based on physical simulations. The addition of 
extra material is described in section 1.4: 17. 

1.4.14 Creation of component locks, room for faceplate and/or multipart shell 

5 As one of the last steps the locks for components and/or room for the faceplate 
need to be created depending on the particular assembling process. 

Component locks 

In many applications locks are needed to make it possible to attach and lock the 
10 . components on the final earpiece - especially if no faceplate is applied. Examples of 
locks are operable locks, one-click locks or bayonet click locks. These locks may be 
created by performing a Boolean subtraction (see section 1.4.16) of the negative of 
the component lock or the component from the present shell. Figure 37 illustrates 
the creation of a lock 3701 for the electronics. 

15 

Room for faceplate 

For different reasons many producers still apply a face or cover plate in the 
assembling, see Figure 1. The position of the faceplate is directly determined by the 
position of the components on the visible part of the surface. To make the 

20 assembling with a faceplate possible room needs to be created for this faceplate, 
I.e. the part of the model, which should correspond to the faceplate needs to be cut 
away. Figure 38 illustrates the final model 3802 after the removal of the faceplate 
part 3803 of the present model. The removal is performed by cutting the model with 
the surface 3801 corresponding to the backside of the faceplate model aligned with 

25 respect the position of the components. Preferably the backside of the faceplate 
presents structures to uniquely position and lock the shell and faceplate. Examples 
of such structures are lines, grids or other locks. Figure 39 illustrates the use of a 
line structure 3903 for locking faceplate and shell. 

30 When a faceplate is applied modifications of the faceplate need to be computer 
controlled if the final earpiece should obtain the same shape as the model before 
room was made for the faceplate. The modification of the faceplate may be 
controlled by supplying the milling paths for a milling device, which can be applied to 
modify the faceplate. The milling paths are generated by offsetting the surface 

35 outward with a distance corresponding to the milling head radius following section 
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1.4.9. The part of the offsetted surface, which corresponds to the faceplate, is then 
sliced using planar surface cuts. For each slice the outer contour is extracted. These 
contours become the milling paths. 

5 An alternative to apply. a full faceplate is to use a small interface module e.g. a small 
ring containing a lock for the components. This interface module can then be glued 
to the shell and the components can be inserted and removed easily. In the full 
frame work the interface module is just interpreted as a component, which may be 
placed together with the other components. 

10 

Mult/part shell 

Another option is to create a multipart shell, i.e. the shell is separated into two or 
more parts, which can be locked together. The separation of the shell into two or 
more pieces allows for easy insertion and replacement of components and reduces 

15 the need for large holes in the shell through which the components can be inserted. 
The separation of the shell into two parts is performed by cutting the present model 
with a single surface, which corresponds to the desired separation surface including 
locks etc. This cutting creates the first part. The second part is then created by 
cutting the present model with the same surface with swapped orientation. In a 

20 similar way more cuts are performed for shells with more than two parts. The 
separation could also be performed using Boolean subtraction. 

1.4.15 Placement of unique identification 

A large number of earpieces may be produced together. In order to distinguish the 
25 individual earpieces a unique feature for identification, such as serial number, 
barcode or colour code, need to be placed on the earpiece. An example of placing 
identification is shown in Figure 39. Preferably the identification should either be 
placed inside the shell 3901 or on an extra piece of material 3902, which can easily 
be removed. In general the identification should be placed such that it easily can be 
30 read automatically, e.g. by a barcode reader or computer vision system. If the rapid 
prototyping device is single-colour, a serial number can be created with 3D 
characters, which are added or subtracted to the surface preferably by a Boolean 
operation, see section 1.4.16. For some single-colour rapid prototyping devices it is 
also possible to create identification by double exposure. In the case where other 
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components are unique for the earpiece, these components can also be assigned a 
unique identification, 

1.4.16 Boolean Operation 

5 Figure 40 shows how a Boolean function can be used to add, A+B, 4003 or subtract, 
A-B, 4004 two models, A 4001 and B 4002. The power of the Boolean function is 
also illustrated in Figure 31, where the outlet 3103 is created using the Boolean 
addition of cylinder model followed by a Boolean subtraction of cylinder model with a 
smaller radius. 

10 

The Boolean algorithm has strong similarities with the surface cutting and closing 
function in section 1.4.4. For each intersecting triangle in model A and B the loop to 
be triangulated can be determined. Recall that the loop consists of the intersections 
of the triangle edges and one or two vertices from the triangle, see Figure 14. 
15 Compared to the cutting and closing function the difference is which vertices in the 
triangle to insert in the loop. 

In the case of the addition, A + B, the. vertices in the loop should be selected as the 
vertices above the other model surface for both A and B. In the same way as in the 
20 cutting operations the triangles below/behind the other surface are removed and the 
two surfaces are merged. 

For subtraction, A-B, the mode! A is treated in the same way as in addition. The 
vertices in the loop for triangles in model B are selected as the vertices below the 
25 surface A. Finally, the triangles in B above/in front of the surface of model A are 
removed and the two surfaces are merged. 

1.4.17 Add/remove material 

Extra material can locally be added or removed. This may be performed by locally 
30 offsetting the surface outwardly or inwardly, respectively. The addition/removal can 
be based on a single point on the surface or selection of an area. In the case of a 
single point the vertices within a specified distance from the points are offsetted as a 
function of their distance to the point. The relationship between the amount of offset 
and the distance is controlled by a proper transfer function, e.g. a Gaussian. The 
35 actual offsetting of the individual vertices is performed as described in section 1.4.9. 
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If the input is a selected area all the vertices within the selection are offsetted. The 
amount of offset is calculated based on the distance from the vertex to the selection 
boundary combined with a proper transfer function. 

In some cases larger amounts of material need to be added, e.g. if parts of the ear 
canal is missing, the canal may be extend. In the general case the material to add is 
preferably extracted from a similar or standard model and added to the model by a 
Boolean operation. In special cases like the extension of the ear canal it may be 
advantageous to fit a parametric surface to the neighbourhood of the extension. 
Additional control of the surface can be obtained by adding a number of surface 
control points, which make the operator freely able to adjust the shape of the 
extension. 

1.4.18 Extracting the most similar model from the database 

15 The core in the similarity-based approach is to extract the model, which is most 
similar to the present model from the database. Preferably the first step is to insert 
the coordinate system in the present model following section 1.4.3. A number of 
features are then extracted from the model. The features should preferably be 
homological points, distances and angles between homological points, lower order 
moments, local curvature and other differential-based features. The applied features 
should preferably be invariant of position, orientation and scale. Together with each 
original model in the database the corresponding features are stored. Each model 
has a corresponding point in feature space. The candidates for the most similar 
model are then extracted as the "nearest neighbours" to the feature point, which is 
related to the present model. Preferably the nearest neighbours are determined 
using the Euclidean or Mahalanobis distance in feature space, neural networks, 
fuzzy logic or another parametric or non-parametric model. 



20 



30 



A registration of the present model and each candidate may then be performed and 
the closest model may be extracted as the most similar model. The closest model 
may be defined with respect to the average least square distance between the 
vertices in the present model and surface of the candidate models. The registration 
may be performed using the Iterative Closest Point algorithm, (Besl, P.J. and McKay. 
N. D.. "A method for registration of 3D shapes', IEEE Transaction on Pattern 
35 Analysis and Machine Intelligence, 17(1), pp. 239-256, 1992). 
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1.4.19 Visualisation and simulation 

The earpiece and the related components can be visualised fully identical to the final 
product, where not just the major components but also wires, connectors and all 

5 other used pieces are included. Simulation may be performed to determine the 
influence and movement of the transducers, tube, wires etc. when the earpiece is 
moved such as when user is moving or eating. These simulations are preferably 
performed using classical physics and also include mutual interaction. The required 
physical parameters such as mass and flexibility are assigned to all the individual 

10 components. One advantage of the physical simulation is the possibility to optimise 
the size of different component, e.g. the length of the wire connecting electronic and 
phone. 

Insertion and removal of the earpiece in the virtual ear may also be simulated. This 
15 simulation ensures that the earpiece is actually able to enter the ear. The simulation 
also includes the amount of deformation and pressure applied to the ear and 
earpiece, which is required for the insertion and removal. The amount and position 
of the ear deformation and pressure makes is possible to estimate the nuisance 
caused by the insertion and removal of the earpiece. Likewise the nuisance can also 
20 be estimated when the earpiece is placed in the correct position. Again realistic 
physical parameters are assigned to the ear and earpiece. The parameters 
assigned to the ear may be obtained by a registration of the ear to an anatomical 
atlas. 

25 Simulations of the acoustic properties of the modelled earpiece can also be 
performed. 

The full visualisation and physical simulations facilitate the most realistic evaluation 
of the modelling result and can be used to optimise the modelling to obtain the 
30 overall most satisfying result. 

1.5 Output of the system 

The final optimal 3D model is then added to the database. The database has a 
number of applications, e.g. it can be applied to produce new earpieces using the 
35 similarity-based approach, derive shape statistics used for purposes such as optimal 
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component design and improved acoustic simulation, perform growth and age 
modelling of the auditory canal and the rest of the ear, reproduce lost or damaged 
earpieces and/or create quality reports. A part of the quality report can be the 
amount of penetration of the virtual ear, see Figure 41 . 

The physical version of the final 3D model may be produced using a rapid 
prototyping set-up such as Milling, stereo lithography/SLA, solid ground curing, 
selective laser sintering, direct shell production casting, 3D-printing, topographic 
shell fabrication, fused deposition modelling, inkjet modelling, laminated object 
manufacturing, nano-printing or any other system that produces real models from 
3D computer models. The final 3D model will be directly saved in a format 
compatible with the manufacturing set-up. Using a packing algorithm a iarge number 
of 3D models may be optimally positioned in 3D space and manufactured 
simultaneously to increase production speed. 

The system is also able to generate post processing instructions and other derived 
data e.g. programs or settings for the corresponding hearing aid electronic. When 
faceplates are used generation of instructions for the milling of the faceplate is 
essential if the correct shape should be obtained. These instructions are also stored 
in the database and can be downloaded to the milling machine manually or 
automatically. 

Instructions for manual or automated assembling are also generated. Preferably 
these instructions include assembling instructions, component specifications and 
optimal dimensions, e.g. of tubes and wires. One use of these instructions is to 
automatically prepare and adjust the components for assembling. Due to the precise 
knowledge of the shape the system is also able to create instructions for automated 
assembling of shell, faceplate, electronics and other components. Without this 
shape knowledge it is basically impossible to perform automated assembling e.g. by 
a robot, due to the small dimensions and high requirements for precision. The 
knowledge of the precise position of components can also be used to mount 
components before or during the production of the shell. The system is also able to 
optimise the position and orientation of the shell in the production to facilitate this 
placement of components. This makes it possible to build component into the shell 
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and to mount components that cannot be inserted into the final shell. Simple 
components can also be created directly, e.g. printed. 

Most of the handling and processing of earpiece require that the identity of the 
5 present earpiece is known. The earpiece is preferably identified automatically, e.g. 
by a barcode reader or computer vision system. 
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2. Claims 

1. A method for computer-assisted modelling of customised earpieces comprising 
at least one part being individually matched to an auditory canal and/or a 
5 meatus, said method comprising the steps of: 

a) obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer surface,. 

10 b) initially arranging at least one component in relation to the 3D-model, 

c) initially arranging a cutting curve or cutting surface in relation to the outer 
surface of the 3D-model, said cutting curve or surface dividing the 3D-model in 
an outer portion and an inner portion, 

15 

d) initially forming a connecting surface connecting the at least one component and 
the inner portion of the 3D-model, said connecting surface thereby being part of 
the 3D-model, 

20 e) performing an evaluation of the arrangement of the at least.one component, said 
evaluation comprising a collision detection of the at least one component in 
relation to one or more parts of the 3D-model and/or other components, and 

f) adjusting the arrangement of the at least one component, the arrangement of 
25 the cutting curve or surface, and/or the formation of the connecting surface 

based on the result of said evaluation. 

2. The method according to claim 1, wherein steps (e) and (f) are repeated until the 
collision detection fulfils a required minimum criterion. 



30. 



3; The method according to any of the preceding claims, wherein the arrangement 
of the at least one component, and/or the arrangement of the cutting curve or 
surface, and/or the formation of the connecting surface is/are adjusted until no 
collision is detected. 
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4. The method according to any of the preceding claims, wherein an object 
function, f(v), is defined for expressing the quality of the arrangement of the at 
least one component, and/or the arrangement of the cutting curve or surface, 
and/or the formation of the connecting surface, said object function being an 
increasing function of the number of detected collisions and being calculated for 
each new arrangement of the at least one component and/or cutting curve or 
surface, and wherein the arrangement of the at least one component, and/or the 
arrangement of the cutting curve or surface, and/or the formation of the 
connecting surface is/are adjusted until the object function fulfils a given 
minimum criterion. 

5. The method according to claim 4, wherein said minimum criterion is that the 
object function obtains a minimum value, or that the difference in the values of 
two successively determined object functions is below a defined value. 

6. The method according to claim 4 to 5, wherein for said object function consists 
of a weighted sum of terms related to constraints and a number of other terms, 
which express the quality of the earpiece. 

7. The method according to claim 6, wherein the other terms are selected from the 
group consisting of the volume of the shell, the outer shell surface, the visible 
shell surface area, the length of intersection between the reference ear and the 
cutting surface, the area of the cutting surface after the cut, the maximal 
penetration of the reference ear by a component, the average of the penetration 
and the acoustic properties. 

8. The method according to any of the preceding claims, wherein a general 
purpose optimisation algorithm, psuedo physics or a combination are used to 
optimise component placement. 

9. The method according to claim 1 , wherein the steps are performed in the order 
a),b),c),d)e),f). 
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10. The method according to claim 1, wherein the steps are performed in the order 
a),c), b),d),e),f). 



11. The method according to claim 1, wherein the steps are performed in the order 
5 a), c), b), e), d), f). 

12. The method according to claim 1, wherein the steps are performed in the order 
a), b), e), c), d), 0. 

10 13. The method according to claim 1, wherein the steps are performed in the order 
a), b), c), e), d), f). 

14. The method according to any of the preceding claims, wherein the 3D model is 
obtained by scanning an impression of the auditory canal and/or concha and/or 

15 meatus and optionally part of the outer ear. 

15. The method according to any of the preceding claims, wherein the 3D model is 
obtained by ultrasound scanning of the auditory canal and/or concha and/or 
meatus. 

20 

16. The method according to any of the preceding claims, wherein the 3D model is 
obtained by scanning the auditory canal and/or concha and/or meatus with a 3D 
structured light scanner. 

25 17. The method according to any of the preceding claims, wherein the 3D model is 
obtained by CT and/or MRI and/or MR scanning of the auditory canal and/or 
concha and/or meatus. 



30 



18. The method according to any of the preceding claims 14 to 17/ wherein the 
scanning further comprises a texture scan, including a colour scan. 



19. The method according to any of the preceding claims, comprising a further step 
during which holes in the 3D model are closed. 
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20. The method according to any of the preceding claims, comprising a further step 
during which defects are removed from the 3D model. 

21. The method according to claim 20, wherein defects are selected from the group 
5 consisting of the thread used for removing the impression, artefacts, scars, 

earwax, tissue, and hair. 

22. The method according to any of the preceding claims, further comprising 
removing unwanted parts of the 3D model surface. 

10 

23. The method according to claim 22, whereby unwanted parts are removed using 
a cutting curve/surface. 

24. The method according to claim 22, whereby unwanted parts are removed by 
15 marking the parts on the 3D-model. 

25. The method according to any of the preceding claims, comprising a further step 
during which a second cutting surface/curve is arranged in relation to the outer 
surface of the 3D model. 

20 . 

26. A method according to any of the preceding claims, wherein the arrangement of 
the at least one component in relation to the 3D-model comprises arranging a 
component surface of the at least one component in relation to the 3D-modeI. 

25 27. The method according to claim 26, wherein a connecting surface is connecting 
said component surface and said inner portion of the 3D-model. 

28. The method according to any of the preceding claims,, wherein said initial 
arrangement of the at least one component in relation to the 3D-model 
30 comprises arranging at least part of the at least one component substantially at 

the interior of the 3D-model. 



35 



29. The method according to any. of the preceding claims, wherein said evaluation 
includes an evaluation of the arrangement of the cutting curve or surface and/or 
the connecting surface. 
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30. The method according to claim 29, wherein the evaluation includes a visual 
evaluation of the arrangement and/or an acoustic evaluation and/or an 
evaluation of the fit in relation to a virtual ear. 

5 

31. The method according to any of the preceding claims, wherein the formation of 
the connecting surface is computer controlled or computer assisted. 

32. The method according to any of the preceding claims, wherein the formation of 
10 the connecting surface comprises a lofting process. 

33. The method according to claim 32, wherein the lofting process comprises fitting 
a parametric surface to the boundary of the inner portion of the 3D-model and to 
the boundary of a surface defining an outer boundary of said at least one 

15 component in relation to the 3D-model. 

34. The method according to any of the preceding claims, wherein the formation of 
the connecting surface comprises a filleting process of the edge or boundary of 
the inner portion of the 3D-model. 

20 

35. The method according to claim 34, wherein the outer shell surface of the 3D- 
model is given in a vertex representation with the vertices being connected by 
triangles, and the filleting process comprises removing at least part of the 
triangles in a neighbourhood around at least part of said edge and fitting a 

25 parametric surface to the neighbourhood of the hole created by the removed 

triangles. 

36. The method according to claim 33 or 35, wherein the parametric surface 
comprises a cubic B-spline surface. 

30 

37. The method according to claim 34, wherein filleting comprises smoothing on the 
edge and its neighbourhood. 
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38. The method according to any of the preceding claims, wherein at least part of 
the inner portion of the 3D-model is shelled, said shelled inner portion having an 
inner and an outer shell surface. 

5 39. The method according to claim 38, wherein the shell of the 3D-model is 
generated by a shelling process being computer controlled or computer 
. assisted. 

. 40. The method according to any. of the claims 38 to 39, wherein the shell of the 3D- 
10 model has a predetermined minimum shell thickness. 

41. The method according to any of the claims 38 to 40, wherein the at least partly 
shelled 3D-model is obtained from a three-dimensional computer model, 3D- 
model, of at least part of the auditory canal, said 3D-model having an outer.shell 
15 surface being parameterised by a number of vertices, which vertices are 

connected by triangles, said shelling process comprising: 

offsetting inwardly a copy of each vertex in the outer shell surface, 

20 removing the number of copied vertices being closer to the outer shell surface 

than a given minimum shell thickness, and 

creating an inner shell by triangulation of the remaining copied vertices. 

25 42. The method according to claim 41 , wherein the size of the offset varies over the 
surface. 

43. The method according to any of the claims 38 to 41, wherein the inner shell 
surface or geometry of the 3D-model is modified in order to improve the strength 
30 of the finished shell, said modification comprising adding extra material to at 

least part of the inner surface of the shell, while at the same time avoiding 
collision between the modified inner shell surface and the arranged components. 
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44. The method according to any of the preceding claims, wherein adding or 
removal of material to the inner shell surface of the 3D-model is performed using 
a Boolean operation, such as a Boolean addition/subtraction. 

5 45. The method according to any of the- preceding claims, wherein adding or 
removal of material in an area comprises selection of a point and the amount of 
offset is a function of the distance from the point, such as a Gaussian function. 

46. The method according to any of the preceding claims, further comprising a 
process comprising an outward offset on at least part of the outer shell surface 
of a 3D computer model, said 3D model having an outer shell surface being 
parameterised by a number of vertices, which vertices are connected, by 
triangles, said process comprising outwardly offsetting a copy of each vertex in 
the outer shell surface, and removing the number of copied vertices being closer 

15 to the outer shell surface than a given minimum distance, and creating a new 

offset surface by triangulation of the remaining copied vertices. 

47. The method according to claim 46, further comprising a lofting process to 
connect the offset part(s) to the non-offset part(s). 



10 



20 



25 



48. The method according to any of the preceding claims; wherein an anatomical 
atlas is used to map soft and hard parts of the auditory canal and/or concha 
and/or meatus to the model 

49. The method according to claim 48, wherein models are grouped to different 
. anatomical atlases by selecting the atlas being most similar to the model. 



50. The method according to any of the preceding claims 48 to 49, wherein different 
materials are assigned to different parts of the model taking the location of hard 
30 and soft parts into consideration. 

.51. The method according to any of the preceding claims, wherein different 
materials are assigned to different parts of the model taking the acoustic 
properties of the materials into consideration. 

35 



WO 02/071794 PCT/DK02/00137 

71 

52. The method according to any of the preceding claims, wherein different 
materials are assigned to different parts of the model taking the. allergenic 
properties of the materials into consideration. 

5 53. The method according to any of the preceding claims,, wherein sweat resistant 
materials are assigned to the part of the models exposed to sweat. 

54. The method according to any of the preceding claims, wherein materials of 
different colour are assigned to different parts of the model in order to create a 

10 visual label or tag on the model and/or to improve the visual appearance of the 

model. 

r 

55. The method according to any of the preceding claims, wherein the inner portion 
of the 3D-model at least partly comprises a representation of a model of an 

15 earpiece. 

56. The method according to any of the preceding claims, wherein the outer portion 
of the 3D-model at least partly comprises a model of a virtual ear. 

20 57. The method according to claim 56, wherein said virtual ear is connected to a 3D 
head model. 

58. The method according to claim 57, wherein the 3D head model is a model of the 
user or a dummy 3D head model. 

25 

59. The method according to any of the preceding claims, wherein the collision 
detection includes a collision detection of a component surface in relation to one 

. or more parts of the 3D-model. 

30 60. The method according to any of the preceding claims, wherein the collision 
detection of the components includes a collision detection of the mutual 
arrangement of the components themselves. 



35 



61 . The method according to any of the preceding claims, wherein said one or more 
parts of the 3D-modej in relation to which the collision detection may be 
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performed comprises at least part of the inner portion and/or at least part of the 
outer portion of the 3D-model. 

62. The method according to claim 59, wherein said one or more parts of the 3D- 
model in relation to which the collision detection may be performed comprises at 
least part of the inner shell surface. 

63. The method according to claim 56 and 59, wherein said one or more parts of the 
3D-model in relation to which the collision detection may be performed 
comprises at least part of an inner surface of the virtual ear. 

64. The method according to any of the preceding claims, wherein said collision 
detection is performed using varying penalties for different parts of the 3D 
model. 

65. The method according to claim 64, wherein the different parts of the 3D model 
comprise representations of soft and hard parts of the auditory canal. 

66. The method according to any of the preceding claims, wherein said collision 
20 detection is performed by inspection of the three-dimensional computer model, 

3D-model. 

67. The method according to any of the claims 1 to 65, wherein said collision 
detection is computer-controlled or computer-assisted. 

25 

68. The method according to any of the preceding claims, wherein the component 
and/or component surface is used to generate the initial cutting curve/surface. 

69. The method according to claim any of the preceding claims, wherein initial 
30 cutting is performed by the component surface. 



70. The method according to claim any of the preceding claims, wherein initial 
cutting is performed by a curve/surface derived from the component surface. 
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71. The method according to any of the preceding claims 1 to 67, wherein the initial 
cutting curve/surface is generated without the component or component surface. 

72. The method according to any of the preceding claims, wherein the initial cutting 
5 curve/surface is marked on an impression before scanning said impression and 

said marking is used to generate the initial cutting curve/surface. 

73. The method according to any of the preceding claims, wherein said initial 
arrangement of the at least one component and/or the cutting curve or surface is 

10 performed manually. 

74. The method according to any of the preceding claims, said initial arrangement of 
the at least one component and/or the cutting curve or surface is performed 
using a feature-based approach, in which features extracted from the obtained 

15 3D-model is used for the arrangement. 

75. The method according to claim 74, whereby texture marked on the impression 
used to generate the 3D-model is used for initial arrangement. 

20 76. The method according to claim 74, comprising slicing at least part of the model 
into slices, selecting a slice fulfilling a number of constraints, and using this Slice 
for initial placement of the at least one component. 

77. The method according to any of the preceding claims, wherein said initial 
25 arrangement of the at least one component and/or the cutting curve or surface is. 

performed using a similarity-based approach, in which the obtained 3D-model is 
compared to a number of stored 3D-models of previously generated optimised 
models. 

30 78. The method according to any of the preceding claims, wherein said initial 
arrangement of the at least one component and/or the cutting curve or surface is 
performed based on mirroring from the optimised other ear of the same person. 
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79. The method according to any of the preceding claims, wherein said initial 
arrangement of the at least one component and/or the cutting curve or surface is 
performed based on an earlier optimised model from the same person. 

i 80. The method according to claim 77, wherein a stored optimised 3D-model is 
selected as the most similar 3D-model and the initial arrangement of the at least 
one component and/or cutting curve or surface is selected substantially equal to 
the optimised arrangement of the at least one component and/or cutting curve or 
surface of said most similar 3D-model. 

81. The method according to any of the claims 77 to 80, wherein said comparison of 
3D-models and selection of the most similar 3D-model is computer-controlled or 
computer-assisted. 

15 82. The method according to any of the claims 80 to 81, wherein said selection of 
initial arrangements of the at least one component and/or cutting curve or 
surface is computer-controlled or computer-assisted. 

83. The method according to any of the preceding claims, wherein said 
20 adjustment(s) of the arrangement of the at least one component and/or the 

cutting curve or surface is performed manually. 

84. The method according to any of the claims 1 to 82, wherein said adjustment(s) 
of the arrangement of the at least one component, and/or the arrangement of the 
cutting curve or surface, and/or the formation of the connecting surface is 
computer-controlled or computer-assisted. 



25 



85. The method according to any of the preceding claims, said method further 
comprising arrangement of components at the interior or inner surface of the 

30 inner portion of the 3D-model. 

86. The method according to claim 85, wherein the arrangement of components at 
the interior or inner surface is optimised using a general purpose optimisation 
algorithm, by psuedo physics or using a combination of both. 
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87. The method according to any of the preceding claims, further comprising the 
arrangement of ribs on the inner and/or outer surface of the 3D model. 

. 88. The method according to any of the preceding claims, further comprising 
5 arrangement of holders such as spikes and/or rings and/or adding of extra 

material to the model. 

89. The method according to any of the claims 85 to 87, wherein said arrangement 
of components at the interior or inner surface and/or arrangement of holders 

10 and/or adding of extra material and/or arrangement of ribs is manual. 

90. The method according to any of the claims 85 to 87, wherein said arrangement 
of components at the interior or inner surface and/or arrangement of holders 
and/or adding of extra material and/or arrangement of ribs is computer 

15 controlled, such as similarity based or ruled based. 

91. The method according to any of the claims 85 to 87, wherein said arrangement 
of components at the interior or inner surface and/or arrangement of holders 
and/or adding of extra material and/or arrangement of ribs is computer assisted. 

92. The method according to any of the preceding claims, wherein at least part of 
the components are selected from a list of components comprising: electronic 
components, outlets to interior components, tubes, ventilation channel, amplifier, 
microphone, vibration pick-up, microchip, transducer, wireless 
communication/identification devices, position sensors such as GPS, 
loudspeaker, tubes, battery, printed circuits, faceplate, surface patches, inlets, 
outlets, wires, conductors, volume controls, nail grip, extraction cord, tele coil, 
locking means, interface modules, identification and logo. 

30 93. The method according to any of the preceding claims, wherein at least one 
component is arranged in a plate. 

94, The method according to claim 93, wherein the component is fixed in the plate 
by a component lock 
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95. The method according to claim 94, wherein the component lock is a bayonet, a 
one-click lock or an operable lock. 



5 



96. The method according to claim 93, wherein the backside of the plate comprises 
structures to lock the plate to the 3D model. 

97. The method according to claim 93 t wherein the backside of a model of the plate 
is used for the initial cut of the 3D model. 



10 98. The method according to claim 93, further comprising cutting a 3D-model of the 
plate with the outer surface of the 3D model. 

99. The method according to any of the preceding claims, said method further 
comprising arrangement of a ventilation channel at the interior or inner surface 

1 5 of the inner portion of the 3D-model. 

100. The method according to claim 99, comprising arranging exit points on the 
canal part and the visible part of the 3D model. 

20 1 01 . The method according to claim 99, wherein the channel is created by adding 
a solid object defined along a path between the exits to the inner shell surface of 
the model. 

102. The method according to claim 101, further comprising subtracting an object 
25 having the shape of the ventilation channel. 

103. The method according to claim 99, wherein the channel is created by adding 
a hollow object defined along a path between the exits to the inner shell surface 
of the model. 



30 



104. The method according to claim 99, wherein the ventilation channel is 
arranged on the outer surface of the model. 



>. The method according to any of the preceding claims, comprising 
arrangement of further channels in the 3D model, such as a large bore (horn 
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effect), a small bore (reverse horn effect), an open bore, a fishmouth bore (bell 
bore), an angle vent, an external vent, a parallel vent or a mini vent plug. 

106. The method according to any of the preceding claims 99 to 105, wherein 
5 ventilation channels and/or sound bores are applied to improve the acoustic 

properties and/or to increase the protection against earwax. 

107. The method according to any of the preceding claims 99 to 105, wherein the 
cross section is circular or elliptical or square/rectangular or T-shaped, or semi- 

10 circular with an edge, or triangular with an edge or circular/elliptical with an 

edge. 

108. The method according to any of the claims 99 to 105, wherein said 
arrangement of channels is manual. 

15' . 

109. The method according to any of the claims 99 to 105, wherein said 
arrangement of channels is computer assisted. 

110. The method according to any of the claims 99 to 105, wherein said 
20 arrangement is of channels computer controlled, such as. similarity based or rule 

based. 

111. The method according to claim 110, wherein said arrangement is based on a 
shortest path algorithm and/or a "water flow" algorithm. 

25 ' 

1.12. The method according to any of the preceding claims, said method further 
comprising an optimisation of the visual appearance. 

113. The method according to claim 112, comprising smoothing or fairing by low 
3d pass filtering of the model surface followed by an anti-shrinkage step. 



114. The method according to claim 112, comprising assigning colours and/or 
texturing to the surface of the shell. 



5 



10 



WO 02/071794 PCT/DK02/00137 

78 

115. The method according to any of the preceding claims, said method further 
comprising placement of a unique identifier at the inner portion of the 3D-model. 

1 16. The method according to claim 115, wherein the unique identifier comprises 
a barcode or another computer readable tag. 

1 1 7. The method according to any of the preceding claims, wherein the optimised 
3D model is divided into two or more parts by arranging one or more further 
cutting surfaces. 

118. The method according to any of the preceding claims, further comprising 
visualisation of the optimised model. 



119. The method according to any of the preceding claims, further comprising 
15 production of a difference map illustrating the difference between the original 3D 

model and the optimised 3D model. 

120. The method according to any of the preceding claims, further comprising 
acoustic modelling of the 3D model. 

20 

121. The method according to any of the preceding claims, further comprising 
generation of assembly instructions. 

122. The method according to any of the preceding claims, further comprising 
25 prototyping and assembly of the earpiece. 

123. The method according to claim 122, wherein the assembly is manual. 

124. The method according to claim 122, wherein the assembly is performed by a 
30 robot being controlled by instructions generated by the computer. 



125. The method according to any of the preceding claims, further comprising 
generation of instructions for milling a faceplace, and computer-controlled milling 
of the faceplate. 
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126. A method for computer-assisted modelling of customised earpieces 
• comprising at least one part being individually matched to an auditory canal 
and/or a meatus, said method comprising the steps of: 

a) obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer surface, 

b) initially arranging at least one component in relation to the 3D-model, 

c) initially arranging a cutting curve or cutting surface in relation to the outer 
surface of the 3D-model, said cutting curve or surface dividing the 3D-model in 
an outer portion and an inner portion, 



15 d) initially forming a closing surface closing the hole partly or completely created in 
the 3D-model by the cutting curve/cutting surface, 

e) performing an evaluation of the arrangement of the at least one component, said 
evaluation comprising a collision detection of the at least one component in 

20 relation to one or more parts of the 3D-model and/or other components, and 

f) adjusting the arrangement of the at least one component, the arrangement of 
the cutting curve or surface, and/or the formation of the connecting surface 
based on the result of said evaluation. 



25 



127. The method of claim 126, further comprising any of the features of any of 
claims 2 to 125. 
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128.. A method for computer-assisted modelling of customised earpieces 
comprising at least one part being individually matched to an auditory canal, said 
method comprising the steps of: 

obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer surface, 

initially arranging a at least one component in relation to the 3D-model, 

initially arranging a cutting curve or cutting surface in relation to the outer 
surface of the 3D-modeI, said cutting curve or surface dividing the 3D-model in 
an outer portion and an inner portion, 

15 said initial arrangement of the at least one component and/or cutting curve or 

surface being performed using a similarity-based approach, in which the present 
obtained 3D-model is compared to a number of stored models of previously 
generated optimised 3D-models, with one of said stored 3D-models being 
selected as the most similar model and the initial arrangement of the at least one 
component and the cutting curve or surface being set substantially equal to the 
optimised arrangements of the at least one component and the cutting curve or 
surface of said most similar 3D-model. 

1 29. The method according to claim 1 28, wherein said comparison of the present 
25 3D-models and selection of the most similar 3D-model is computer controlled or 

computer assisted. 

130. The method according to claim 128 or 129, wherein said selection of initial 
arrangement of the at least one component and the cutting curve or surface is 

. 30 computer controlled or computer assisted. 

131. The method according to any of the claims 128 to 130, said method further 
comprising the step of initially forming a connecting surface connecting the at 
least one component and the inner portion of the 3D-model f said connecting 

35 surface thereby being part of the 3D-model. 



20 



WO 02/071794 



81 



PCT/DK02/00137 



1 32. The method according to any of the claims 1 28-131 , wherein the present 3D- 
modei and the stored previously optimised 3D-modeIs have an outer shell 
surface being parameterised by a number of vertices, which vertices are 

5 connected by triangles, and said selection of the most similar 3D-model 

comprises: 

extracting a number of features from the present 3D-model, 

10 comparing said number of extracted features with corresponding stored features 

of a number of stored 3D-models, and 

selecting a number of stored 3D-models as candidates for the most similar 3D- 
model, said candidates being the stored 3D-models having the compared 
15 features being nearest neighbours, in a feature space, to the feature points of 

the present 3D-model. 

1 33. The method according to claim 1 32, said method further comprising: 

20 registration of the present 3D-model and the selected candidate 3D-models, 

selection of the most similar 3D-model as the model of candidate 3D-models 
having the smallest distance between the outer shell surface of said candidate 
3D-model and the outer shell surface of the present 3D-model. 

25 

134. The method of claim 128, further comprising any of the features of any of 
claims 2 to 125. 

135: A method for computer-assisted modelling of customised earpieces 
30 comprising at least one part being individually matched to an auditory canal, said 

method comprising the steps of: 



obtaining a three-dimensional computer modej, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer surface, 
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initially arranging a at least one component in relation to the 3D-model, 

initially arranging a cutting curve or cutting surface in relation to the outer 
surface of the 3D-model, said cutting curve or surface dividing the 3D-mbdel in 
an outer portion and an inner portion, 



said initial arrangement of the at least one component and/or cutting curve or 
surface being performed using a feature-based approach, in which features 
extracted from the obtained 3D-mode! are used for the arrangement. 
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136. A computer program product including a computer readable medium, said 
computer readable medium having a computer program stored thereon, said 
program for causing computer-assisted modelling of customised earpieces 
5 comprising at least one- part being individually matched to an auditory canal, said 

program comprising: 

program code for causing a computer to obtain a three-dimensional computer 
model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
10 outer surface, 

. program code for causing a computer to initially arrange at least one component 
in relation to the 3D-model, 

15 program code for causing a computer to initially arrange a cutting curve or 

cutting surface in relation to the outer surface of the 3D-model t said cutting 
curve or surface dividing the 3D-modei in an outer portion and an inner portion, 

program code for causing a computer to initially form a connecting surface 
20 connecting the at least one component and the inner portion of the 3D-model, 

said connecting surface thereby being part of the 3D-model, 

program code for causing a computer to perform , an evaluation of the 
arrangement of the at least one component, said evaluation comprising a 
25 collision detection of the at least one component in relation to one or more parts 

of the 3D-modeI, and 

program code for causing a computer to adjust the arrangement of the at least 
one component, the arrangement of the cutting curve or surface, and/or the 
30 formation of the connecting surface based on the result of said evaluation. 

.137. . The computer program product according to claim 136, in the physical form 
of a hard disc, a floppy disc, a magnetic data carrier, a ZIP, a smart card, a CD 
ROM, or a DVD. 

35 
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138. The computer program product according to claim 136, further comprising 
program code for causing a computer to perform any of the steps of any of the 
methods of claims 2 to 125. 

5 139. A computer data signal embodied in a signal wave, said computer data 
signal including a computer program, said program for causing computer- 
assisted modelling of customised earpieces comprising at least one part being 
individually matched to an auditory canal, said program comprising: 

10 program code for causing a computer to obtain a three-dimensional computer 

model, 3D-modeI, of at least part of the auditory canal, said 3D-model having an 
outer surface, 

program code for causing a computer to initially arrange at least one component 
15 in relation to the 3D-model, 

program code for causing a computer to initially arrange a cutting curve or 
cutting surface in relation to the outer surface of the 3D-model, said cutting 
curve or surface dividing the 3D-model in an outer portion and an inner portion, 

20 

program code for causing a computer to initially form a connecting surface 
connecting the at least one component and the inner portion of the 3D-model, 
said connecting surface thereby being part of the 3D-model, 

15 program code for causing a computer to perform an evaluation of the 

arrangement of the at least one component, said evaluation comprising a 
collision detection of the at least one component in relation to one or more parts 
of the 3D-model, and 

10 program code for causing a computer to adjust the arrangement of the at least 

one component, the arrangement of the cutting curve or surface, and/or the 
formation of the connecting surface based on the result of said evaluation. 
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140. The computer data signal according to claim 139, further comprising 
program code for causing a computer to perform any of the steps of any of the 
methods of claims 2 to 125. 

5 141. A system for computer-assisted modelling of customised earpieces, said 
system including computer readable memory having one or more computer 
instructions stored thereon, said instructions comprising 

instructions operative to cause the computer to obtain a three-dimensional 
10 computer model, 3D-model, of at least part of the auditory canal, said 3D-model 

having an outer surface, 

instructions operative to cause the computer to initially arrange at least one 
component in relation to the 3D-model, 

15 

instructions operative to cause the computer to initially arrange a cutting curve or 
cutting surface in relation to the outer surface of the 3D-model, said cutting 
curve or surface dividing the 3D-model in an outer portion and an inner portion, 

20 instructions operative to cause the computer to initially form a connecting 

surface connecting the at least one component and the inner portion of the 3D- 
model, said connecting surface thereby being part of the 3D-modeI, 

instructions operative to cause the computer to perform an evaluation of the 
25 arrangement of the at least one component, said evaluation comprising a 

collision detection of the at least one component in relation to one or more parts 
of the 3D-model, and 

instructions operative to cause the computer to adjust the arrangement of the at 
30 least one cbmponent, the arrangement of the cutting curve or surface, and/or the 

formation of the connecting surface based on the result of said evaluation. 



142. The system according to claim 141, comprising a 3D scanner, a computer 
and a computer controllable rapid prototyping machine. 



3 
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143. The system according to claim 142, wherein the rapid prototyping machine is 
capable of performing 3D milling and/or stereo lithography/SLA and/or solid 
ground curing and/or selective laser sintering and/or direct shell production 
casta* and/or SD-printing and/or topographic shell fabrication and/or fused 
deposition modelling and/or Inkjet modelling and/or laminated object 
manufacturing and/or nano-printing. 

144. The system according to claim 142, wherein the scanner and/or the 
prototyping machine are connected to the computer via a local area network. 

145. The system according to claim 142, wherein the scanner and/or the 
prototyping machine are connected to the computer via the internet 

146. The system according to claim 142, wherein the 3D scanner, the computer 
and the rapid prototyping machine are placed in the same locality. 

147. The system according to claim 142, wherein the computer is placed at a 

"modelling site". 

148. The system according to claim 142, wherein the rapid prototyping machine is 
placed at a "rapid prototyping site". 

149. The system according to claim 142, wherein the 3D scanner is placed by an 
audiologist or an otologist. 

150. The system according to any of claims 141 to 149, further comprising a 
database, wherein scan data are stored. 

151. The system according, to any of claims 141 to 150, comprising a further 
database, wherein 3D data for customised earpieces are stored. 

152. The system according to any of claims 150 to 151, wherein the data are 
stored together with information identifying the users of the customised 
earpieces. 
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153. The system according to any of claims 141 to 152, comprising a further 
database, wherein 3D data for components from different manufacturers are 
stored." 

5 154. The system according to any of claims 141 to 153, further comprising a 
spaceball TM tracking device to assist in manual or computer assisted 
modelling. 

155. The system according to any of claims 141 to 154, further comprising stereo 
10 glasses to assist in manual inspection of 3D computer screen models. 

156. The system according to any of claims 141 to 155, further comprising a robot 
for automatic assembly of the earpiece. 
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1 57. A method for shelling a 3D model, said method comprising the steps of: 

obtaining a three-dimensional computer model, 3D-model, of at least part of the 
auditory canal, said 3D-model having an outer shell surface being 
parameterised by a number of vertices, which vertices are connected by 
triangles, and 

performing a shelling process to obtain a shelled 3D-model of at least part of the 
auditory canal, said shelling process comprising: 

. offsetting inwardly a copy of each vertex in the outer shell surface, 

removing the number of copied vertices being closer to the outer shell surface 
than a given minimum shell thickness, and 

creating an inner shell by triangulation of the remaining copied vertices. 

158. A computer program product including a computer readable medium, said 
computer readable medium having a computer program stored thereon, said 
program for causing computer-assisted shelling of a 3D model, said program 
comprising: 

program code for causing a computer to obtain a three-dimensional computer 
model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
outer shell surface being parameterised by a number of vertices, which vertices 
are connected by triangles, and 



program code for causing a computer to perform a shelling process to obtain a 
shelled 3D-model of at least part of the auditory canal, said shelling process 
comprising: 



program code for causing a computer to offset inwardly a copy of each vertex ii 
the outer shell surface, 
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program code for causing a computer to remove the number of copied vertices 
being closer to the outer shell surface than a given minimum shell thickness, and 

program code for causing a computer to create an inner shell by triangulation of 
5 the remaining copied vertices. 

159. A computer data signal embodied in a signal wave, said computer data 
signal including a computer program, said program for causing computer- 
assisted shelling of a 3D model, said program comprising: 



10 



15 



program code for. causing a computer to obtain a three-dimensional computer 
model, 3D-model, of at least part of the auditory canal, said 3D-model having an 
outer shell surface being parameterised by a number of vertices, which vertices 
are connected by triangles, and 

program code for causing a computer to perform a shelling process to obtain a 
shelled 3D-model of at least part of the auditory canal, said shelling process 
comprising: 



20 program code for causing a computer to offset inwardly a copy of each vertex in 

the outer shell surface, 

program code for causing a computer to remove the number of copied vertices 
being closer to the outer shell surface than a given minimum shell thickness, and 

25 

program code for causing a computer to create an inner shell by triangulation of 
the remaining copied vertices. 

160. A system for computer assisted shelling of a 3D model said system includinv 
30 . computer readable memory having one or more computer instructions stored 
thereon, said instructions comprising; 



instructions operative to cause the computer to obtain a three-dimensional 
computer model, 3D-model, of at least part of the auditory canal, said 3D-model 
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having an outer shell surface being parameterised by a number of vertices, 
which vertices are connected by triangles, and 

instructions operative to cause the computer to perform a shelling process to 
obtain a shelled 3D-model of at least part of the auditory canal, said shelling 
process comprising: 

instructions operative to cause the computer to offset inwardly a copy of each 
vertex in the outer shell surface, 

instructions operative to cause the computer to remove the number of copied 
vertices being closer to the outer shell surface than a given minimum shell 
thickness, and 



15 



instructions operative to cause the computer to create an inner shell by 
triangulation of the remaining copied vertices. 
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